Most likely, it could help slow the process (buy time for firefighters to arrive) in some percentage of cases.

Provided large amounts of nitrogen and an already empty battery (devoid of chemical energy), in a small percentage of cases, it might prevent a fire.

However, having seen a lithium polymer cell heat up from mechanical damage (a drone crash), I can confidently tell that very high temperatures can be achieved without oxygen.