A simpler answer might be llamafile if you're using Mac or Linux.
If you're on windows you're limited to some smaller LLMs without some work. In my experience the smaller LLMs are still pretty good as chat bots so they might translate well.
Comment on [deleted]
db0@lemmy.dbzer0.com 6 months ago
Yes, just grab any recent LLM like Mistral-7B and ask it to translate for you. A local client is here github.com/LostRuins/koboldcpp but you might need a good GPU to get quick answers.
Alternatively use lite.koboldai.net to use someone else’s computer.
bobburger@fedia.io 6 months ago
hemko@lemmy.dbzer0.com 6 months ago
How trustworthy are LLM translations? Normal machine translation may lose context but I imagine LLM could make up shit?
db0@lemmy.dbzer0.com 6 months ago
All translations are LLM translations by this point I believe.
Natal@lemmy.world 6 months ago
Translator here. They do make up stuff or omit stuff they don’t like. Machine translation is fine for tourists or to translate a ikea manual in the wrong language. If there are stakes, risky. They got good enough to make sentences that look right so it can be tricky to spot the errors if you don’t pay attention.
Numbers are typical errors. Sometimes it’s there but the number has changed. Sometimes it’s not there at all. Oh and if you have currencies a translators knows a document from the UK in pounds that is adapted for France will have to be converted in euros. Machines don’t.
Generally speaking when a client wants to use machine translation, it costs them more money in the end because of the extra time needed to correct everything to a high human grade standard.
impure9435@kbin.run 6 months ago
From my experience: They're pretty good