As long as you have good goggles it can be safe, but anyone around you nearby that could get hit by a stray beam or reflection must wear them as well, although that can be pretty expensive for multiple pairs.
There is no harm - pun intended in starting out with <5mW lasers. Once you get used...