Well, there are two things I would check:
1). Use a DMM to check the voltage of the battery to make sure it's good. I've not heard of rayfoss shipping bad batteries, but other vendors have. Not likely, but possible.
2). Are you sure that you put the battery in correctly? Most greens are...