Best AI setup for intelligent srt subtitles translation

Posted by CaterpillarOne6711@reddit | LocalLLaMA | View on Reddit | 8 comments

Okay so basically I'm trying to translate tons of srt files (cations subtitles) from one language to another and I'm trying to do it intelligently sentence by sentence and not line by line.

My hardware:

CPU 5900x

RAM 64gb + (up to 80gb)

GPU 4070 12GB VRAM

I've tried various versions of deepseek such as 7b, 8b, 14b and gpt oss 20b on both ollama and lm studio and I noticed that 20b is the only one intelligent enough to do the job, but the thing is 20b on ollama and lm studio is hella slow, so I tried running it on llama.cpp and it turned out to be 10-20x faster. But the thing is 20b refuses to translate large files, when I tell it to translate large files and specifically tell it not to reason about the length of the text and to translate never stop, it starts to reason that the file is too large and chunk it every time, so that I have to to remind it to keep on translating.

Is there any workaround?