At the point, 100ft away? Unlikely. But there are calculators to figure this out such as EasyHaz:
http://laser-professionals.com/resources/easyhazweb.htm
For example, entering 445nm, 1 watt, for a 1 second exposure; beam diameter of 2mm and beam divergence of 1.5mRad we get:
~OD3 eyeware required
Intrabeam NOHD (meaning, a direct hit from the beam - Nominal Ocular Hazard Distance) - the distance you can be from the laser and 'survive' (optically) a direct hit from the beam: 2.51e+2m, or 251m (or about 750 ft) ... (taking into account divergence there, too.)
Now what you're concerned about is Diffuse Reflection NHZ - the distance at which you can stop worrying about reflections damaging your eyes from the laser (worst case), and that shows: 0.133m or 0.4ft; about five inches or so. Now keep in mind, that is *diffuse* reflection, not specular. (This goes up a little for prolonged exposure; but not much. Probably ~7 inches from 5 inches. The direct exposure limits go up by quite a bit, to about 1000ft.)
But, that said, in summary, yes, you'd be fine looking at the dot on a tree from 100ft away. However, I have to underline: mistakes happen, so thats why you wear the goggles. Not for when things 'go as planned', but because sometimes they don't.
EDIT: What Laser_Freak said, but in more words. heh.