I think you can do a memtest with Windows included tool that doesn’t require to install anything. Type memory check or something in the Start menu and the system should require a restart to boot on the memtest.

But obviously setting up a dedicated thumb drive can be useful too.