My approach would be to get a tube of silicone caulk that handles a decent range of temps and a length of hose that fits over the tip of the tube to reach under if the caulk won’t reach on its own.