I made an open-source GUI for local semantic search, supporting many embedding models from HuggingFace

Posted by leonrjg@reddit | LocalLLaMA | View on Reddit | 4 comments

Hi, everyone, the other day I was looking for an *easy*, plug-and-play app to run embedding models locally and had surprisingly few results.

Many tools like this must exist already but based on my survey, they are either command line interfaces, they require multiple components running together, e.g. Open Notebook, or they support only a couple models.

To make it short, it's a local, plug-and-play, cross-platform app for exact or semantic search across PDFs and other text files. It supports a wide range of embedding models from HuggingFace.

GitHub: https://github.com/leonrjg/Wilkes

You can also try it online: https://demo.wilkes.app/ (this is a load balancer of several instances running on a VPS so indexing won't be fast).

I understand trying an unknown project is a security concern, so please use the Docker version if you're interested :)

[-]

Then_Illustrator9892@reddit

looks super useful, ive been wanting something exactly like this for my local document collection. the fact it runs offline is a huge plus for privacy and just not dealing with api costs.

i tried a few other options last month and you're right, they either needed a whole docker compose setup or only worked with like two models. it got annoying fast having to piece everything together myself.

the docker suggestion is smart for people who are wary. makes it way easier to test in an isolated environment without messing up your system. the demo link is a good touch too for a quick sense of it.

honestly gonna clone it and give it a spin this weekend. if it works as described you've saved me a ton of setup headache. nice work.

crantob@reddit

Congrats for getting it to publishable.
For anyone else reading, here's what is involved:

Rust 67.4%

TypeScript 31.1%

Python 0.7%

Dockerfile 0.3%

CSS 0.2%

JavaScript 0.2%

Other 0.1%

It's easy to get in the free candy van indeed, not easy to get out.

Ill stay free, outside, with perl and CLIO.

Spectrum1523@reddit

Perl, really?

Yes it's liberating.