Found a few things:

A carved and polished table, shows color and cross section well.

Image

A wiki for a minecraft clone that already has baobob wood.

Following another poster’s advice, here’s a cross section of one cut down.

Image

In other depictions it often has little holes in it, which seems like a thing that happens to some baobob wood, otherwise it kind of just looks like medium color wood with some dark bands.