You can probably find an IR filter and add it if you are concerned. One thing I've noticed though, the IR leaking from a 532 nm pointer isn't well focused or even collimated to infinity. Regardless, don't let it get into your eye, unfocused coherent light can be focused by the lens in your eye to a tiny point and burn a hole in your retina.
Here are a bunch of them which are rather large diameter compared to the size of a normal 532 nm beam output, you could cut them down and place or fasten somehow to cover the output.
IIRC, that 304 is the exact same laser as the 303 style ones on eBay. At most, they have a 20% 1064nm component which at a typical 80 mW is 16 mW of IR. If it does follow the visible beam you have nothing to worry about. If it is not collimated you still have nothing to worry about because your eye can only focus a tiny portion of that onto your retina. Far less than 1 mW.