Except if you have a good optic, you can just adjust clicks to rezero (ie: pre-zero both barrels. When you swap barrels, adjust to the pre-determined zero). Or you can use a good optic mount like a LaRue and simply swap optics.
Not a lot faster than an extra upper, but definitely lighter.
Bookmarks