Um, guys, that 500mW is no magic number, even if it is used to designate between Class 3b and Class 4 lasers. The meaningful distinction between a Class 3b and Class 4 laser designation is that the Class 4 is an environmental hazard (e.g. fire), whereas anything Class 3b and above is an eye hazard, but generally not going to burn things without trying hard.
That "trying hard" carries meaning too. You can produce power densities rivaling Class 4 lasers if you use a magnifying glass with Class 3b or possibly Class 3r lasers. Everyone knows that people can burn paper and matches by focusing a weaker laser down. That 500mW is just a ball-park power figure for a laser beam of an average diameter (3mm? I don't know). Likewise, if you spread out a Class 4 laser over a wide area, it may not actually be harmful for your eyes.
To summarize: don't think you're "safe" viewing a dot from a 30mW anymore than 500mW. The latter has greater potential to cause damage, but they're both not eye-safe in different conditions. You should also wear goggles for the incidents you don't plan for; that's what they're really there to protect you against. What if you bump the table and the laser reflects off the shiny surface of your desk or something? Even a reflection off a diffuse surface may hurt your eyes, or at least irritate them. You should enjoy viewing your lasers, not squint and look away because you're uncomfortable.