This already exists. Get ComfyUI and download their video creation plugin. Or there’s one that works with A1111, but I think it’s not quite as good.