However, is giving your credit card or bank transfer information to a website
You are not giving your payment information to the website. You’d be giving to a payment processor, which has to go through all the regulatory oversight. So, yes, I trust Stripe to handle my payment information more than I’d ever trust any random instance admin with my email.