You can’t built it yourself but you can download it and run it locally on your machine without it interacting to any server.

There is a community-driven project aimed at making a fully reproducible version called Open-R1. You can find it at https://github.com/huggingface/open-r1.