I've been seeing a lot of RAG projects fail for predictable reasons (structured data, calculation queries, etc), so I built a tool that analyzes your docs/queries upfront to predict if RAG will actually work.

It's basically a compatibility checker that tells you:

- If your documents will work with RAG (tables/Excel = bad)

- If your queries are RAG-compatible (math = impossible)

- Rough cost estimates

GitHub: https://github.com/ragnostics/ragnostics-tool

The tool is rough and probably too pessimistic. I'm wondering:

1. Is this actually useful or am I solving a non-problem?

2. What other failure patterns should it check for?

3. Are my assumptions about RAG limitations outdated?

There's a paid version with more features, but honestly I'm more interested in whether the core concept is even valuable. Would you use something like this before starting a RAG project?