TheaterFire

Minicpm-V-4

Posted by lly0571@reddit | LocalLLaMA | View on Reddit | 6 comments

Reply to Post

6 Comments

lly0571@reddit (OP)

https://preview.redd.it/bpy1hvrqoihf1.png?width=3835&format=png&auto=webp&s=fe9dbeabaa53cb1fcefaeb927e53d9042ee39e8a Among the three 4B-level VLMs(using Q6 GGUF for Minicpm, F16 weight & vllm for Qwen, Q4 Ollama GGUF for gemma), I still think that Qwen2.5-VL-3B performs relatively better in extracting structured information from images. However, I'm particularly interested in this model's video understanding capability. Given its high token density—encoding a 448×448 image into a single tile of 64 tokens, meaning each token represents approximately 3,000 pixels—it could be a promising candidate for training a compact video understanding model.
View on Reddit #63584706

ali0une@reddit

With llama.cpp their Q4_K_M gguf answers in chinese most of the time if i provide an image and ask "describe image in details" ... is there a way to make it answer in english only or do i have some skills issue?
View on Reddit #63551077

hapliniste@reddit

GPT-OSS for orchestration and tool call with this model as a "vision tool" to do some ui use? Cant wait for the next 2 month with the new models
View on Reddit #63540829

paryska99@reddit

Hell yeah, MiniCPM always seemed to deliver some interesting capability
View on Reddit #63524203

abskvrm@reddit

Vision capability looks good.
View on Reddit #63523229

MustBeSomethingThere@reddit

They have a GGUF version too: [https://huggingface.co/openbmb/MiniCPM-V-4-gguf](https://huggingface.co/openbmb/MiniCPM-V-4-gguf)
View on Reddit #63522299