I wouldn’t worry about this too much. He’ll stop bothering you if you seem uninteresting enough, so just give him minimal uninteresting answers. If he continues to bug you, that could potentially constitute workplace harrassment. If it gets to that point, warn him once. If he still persists after that, talk to your superior. Simple.