Nah, totally normal, my dog came with one too when he was a puppy. Was supposed to smell like his Mom to help him settle in a new home.

If it helps you not pee in your crate I say you keep it.