As far as I understood lithium ion batteries still need oxygen from the air to burn.

This is incorrect.

The most common method for addressing a lithium-ion vehicle fire involves fully submerging the vehicle to allow the energy to dissipate as steam.

However, many underground parking facilities in my area are beginning to ban electric cars, as more fires start to occur, and retrofitting the necessary tanks to ensure fire safety is proving challenging.