Here are some FOSS games on Android that can be played on a portrait orientation.

Mental Math

Tessel - A tiling game

Flang - it’s like chess, but not chess.

2048

BlastOff - endless runner

Chip Defense - it is a tower defence type of game, and is one of my favourites. You should try it.