I don’t think you can damage anything by doing that - maybe you’d run into problems if the keyboard needs more current than the USB port can provide, but even then the keyboard just wouldn’t do anything