For heavier items I just put them in a bicycle bag on the back of the bike. You then don’t need to carry anything on your back.

For rainy and cold weather I just wear gloves + a thin scarf + a shirt + sweater and then a breathing rain jacket. You’ll get warm soon enough bicycling and it works well for that.