You can get a lot done currently with ARC. The mobile ARC versions share system memory, So if you get a mini PC with ARC and upgrade it to 96GB, you can share system ram with the GPU and load decently large models. They’re a little slow it not being vram and all, but still useful (and cheap)

www.youtube.com/watch?v=xyKEQjUzfAk

I have it running on a zenbook duo with 32GB so I can’t load the 70B models, but I works shockingly well.