Battery not holding charge

Hello! I have two video doorbells probably about 5 years old. The charge only lasts about a month. There is not much activity so that isn't the problem. I'm using all the recommended settings for max battery life. In fact I turned off the second doorbell and its battery also loses strength even though it is not turned on. Can I simply replace the batteries or do I need to purchase new doorbells? Thanks!