It battery adapter can let you use Li-ion battery(10440) to replace old 4V lead acid battery

You also need order material as below:
Copper foil
Conductive gasket

You can use 2 of 10440 battery (3.7~4.2v in parallel)