classifier model which labels the ads

Not exactly my idea, I read about it somewhere when news about YT supposedly serving server-side ads started to spread.

You could record the video several times and check for differences between streams and then cut them off, might be more resource intensive in network and storage, but I think it’s still cheaper than a neural network.