Addyad

• 1-bit Bonsai Image 4B and Ternary Bonsai Image 4B Image Generation for Local Devices with just 0.93 GB and 1.21 GB respectively of Diffusion Transformer Footprint. So tiny!

  Posted by Addyad@reddit | LocalLLaMA | View on Reddit | 16 comments

• Latest llama.cpp fork + Turboquant + Planarquant + Isoquant

  Posted by Addyad@reddit | LocalLLaMA | View on Reddit | 6 comments