The only way to safely remove the window would be to remove the diode from the housing and De-can it or at least bend open the front of it to get the window out.
It is glued down on the inside of the diode. It is larger than the opening. Breaking the pieces up to get them out of the little hole is VERY dangerous for the little wires inside the diode.