Old battery's probably swelled up and that's why it's getting stuck. Don't be shy about removing the entire top cover and front of the frame, if needed.

If you own an electronic device - and who doesn’t? - you need a battery backup with a surge protector. These essential devices are designed to work with various equipment, including computers, home ...