It was a joke rather about potentially finding you had a secrect Nazi neighbour than a reference to real happenings! You’d have to be pretty determined to lug a great price of rock about with you if you were on the run!

I did see another article today saying it was a soldier, but not a German, who brought it to the US. So your comment appears to be in line with what happened here.