Short answer - you are right to worry.
Longer answer: there are two distinctly different constructions of those screens.
(a) Two, almost same thickness, pieces of Saphire(synthetic) and red mineral glass, bonded together. Those actually don't delaminate much, you can occasionally pop one of those out with no damage. Put in cold oven, turn on to 350f., check after 5-6 minutes, and every 2 minutes thereafter. At some point it will push out easily.
(b)THick piece of Saphire with thin piece of red plastic film, like spotlight "gel", bonded to it with clear silicone. It will go to crap in the heat, but it can be reglued. Caveat - the logo which is painted onto the back of the Saphirre is generally just done with some type of common enamel, and will be lost while you are cleaning the old silicone off the Saphirre.