AE XM193 for practice and hornady223 75 for defense

Is this bad if I primary use American Eagle 5.56 55 grain FMJ for practice and then use Hornady .223 75 grain TAP for defense? I heard the different grain weights can throw off the sight settings.

I would use the practice ammo for WTSHTF scenarios and also at my indoor range that can’t be steal.

50 yards or less… No but 100 yards and further yes. You will see around 2"-3" diff POI at 100 yards.