To remove the battery, try pulling it off sideway and pushing it outward using both hands. New batteries may need to settle into the battery housing.
Avoid leaving your battery in the tool when storing it.