Are you self hosting the long context llm, of do what are you using?

I did a lot of my exploration back when GPT4 128K over API was the only long-context game in town.

I imagine the options are much better these days between Llama 3/4, Deepseek, and Gemini, and Qwen — but haven’t tried them locally myself.