It looks to me like the circuit already isolates the batteries when the 12v supply is plugged in anyway, but regardless I would definitely be charging them external to the device. I have a dedicated charger already so it would be quicker and easier to use that and just swap in a new set as needed. I’ll be 3D printing adapter housings such as this, so adding a diode into that assembly should be easy enough. Thanks for your advice!