I have Windows 10, so things may be different for 11 or whatever version you’re on, but can’t you just uninstall OneDrive without specifically closing it? I feel like that’s what I did when it was default installed.