Did you check github.com/toverainc/willow-inference-server/ ? I tried it with an ESP-BOX (running github.com/toverainc/willow) and the first results are really promising.