SSL is not the tool you need in this case, although you should obviously already be running exclusively on encrypted traffic.

The problem here is one of access rights - you should not make files default-available for anyone that can figure out the file name to the particular file in the bucket. At the very least, you need to be using signed URLs with a reasonably short expiration, and default all other access to be blocked.