So LOTS of lateral play, tried to remove the hex head bolt on selector to see what the problem is and snapped it right OFF.

God I hate ambi selectors. Gonna just grab a regular Colt selector and be done with it.