No. You won't damage the rail if you're not doing anything ridiculous. The finish wear may accelerate, but If it were me, I wouldn't care about that.

If I were going back and forth, I'd prefer to leave it on one gun for a while due to the reasons mentioned above.