50mW is fine even without goggles, as long as you don't shine at glossy surfaces. No glass, no metals, nothing polished. Such materials can reflect the beam back (or at other poeple) and such reflection will be dangerous. Of course direct beam is dangerous, so don't shine it anywhere where people or animals can be expected.
As for burning, it could do some very basic things, like popping black balloon or cut thin black plastic back. You wont be able to light a match with it.
It will have nice beam at night, cool beam in fog or smoke. The dot will be very bright even at day, at night it will be on verge of being hard to look at.
Sure, there is some risk involved. Goggles would help you. On the other hand, you won't see anything of such laser in the goggles. It would be hard to tell if the laser is on.