My S&W is a very matte finish. Somewhat gray as well. I was thinking of using the lower for my SBR project with a BCM 11.5". I can relate to the OP’s concern.
Oiling the lower DOES help with the color matching. Hopefully they will both dry and look similar. Nothing like carrying an oily rifle through the corn fields looking for the “elusive and dangerous” South Texas feral hog!