RAG of financial statements

Posted by Less_Piccolo_6218@reddit | LocalLLaMA | View on Reddit | 1 comments

Good afternoon! I would like to know how to use Ollama to read my financial statements, understand them and provide me with insights. I want to do everything locally for privacy reasons. I have company and personal statements. Currently I already run qwen2.5-7B locally, could I use it for that?

[-]

ChapterEquivalent188@reddit

You have the right model (Qwen 2.5 is excellent for this), but you are likely missing the most important piece: The Ingestion Layer.

Financial statements are 90% tables. If you just feed the raw PDF text into Ollama (or use a standard RAG script), it will fail miserably because the table structure gets destroyed. The LLM will see a soup of numbers and hallucinate the insights.

Here is the local stack I use for exactly this (Privacy-First):

Parser: Docling LLM: Feed that Markdown into Qwen 2.5 via Ollama.

Don't try to make the LLM 'read' the PDF directly. Use a specialized parser to turn the PDF into Markdown first. Hope it helps ;)