Not wearing laser goggles or glasses just means that you have no ocular/eye protection if a laser accident situation occurs.
An accident is by definition not a planned event and they do happen in less time than the human blink reflex on 0.25 seconds,which mean no time/not possible to correct once an accident is in progress, so use caution and be sure you know the functional behavior of the laser and all circumstances of use when taking your chances and using the laser without goggles/glasses.
It may be useful for you to understand why you see a laser "beam" at all/ever.
The fundamental reality of "beam" visibility as follows:
It is not a matter of output power or wavelength.
A "laser beam" is invisible in a vacuum regardless of wavelength or power.
Beam visibility to an observer is complicated real world phenomenon of light, eye sensitivity, and reflection from particle/aerosols in the air the details of which are not intuitively obvious.
At sea-level, one cubic inch (1 inch x 1 inch x 1 inch) (16.39 cm3) of "air" contains approximately 400 billion billion (4*1020) air molecules, each moving at about 1600 km/hr (1000 miles/hr), and colliding with other molecules and anything else they come into contact with about 5 billion times per second. This is the reason for "air pressure". The amount of particles in that air that can reflect a portion of a laser beam's light back to your eye determines if you can see it or not.
It all depends upon atmospheric conditions--a beam you can see extremely well in fog or area with high concentration of particulate matter in the air can be almost invisible in clean clear air
Laser beam visibility is highly dependent on ever changing atmospheric conditions and aerosols in the air.
You never actually see the laser beam --what you see is the reflections from particles in the air.
"It is extremely small airborne particles called aerosols having a diameter significantly less than the wavelength of the light that causes the beam to become visible.
The effect of minute particles scattering light is called Rayleigh scattering and it's most noticeable effect is to turn the daytime sky blue. Rayleigh scattering causes photons to be scattered in a roughly spherical manner around these particles. Some of the light is scattered forward (in the direction of the beam), a lesser amount is scattered to the sides and about the same amount that is scattered forward is scattered backwards towards the light source. This backwards scattering is why the beam is more visible to people standing near the astronomer using it, than people standing some distance to the side. The more of these minute particles there are in the atmosphere, the more Rayleigh scattering there is."
From :RASC Calgary Centre - The Atmosphere, Astronomy and Green Lasers
http://calgary.rasc.ca/atmosphere.htm