hellninja55

u/SensitiveCranberry Can you guys put the 70b model there as well?

The newest Fish Speech model supports portuguese, but keep in mind you need at least one minute of reference audio for it to work well. Here is a sample: [https://vocaroo.com/1n69hlXD60Uu](https://vocaroo.com/1n69hlXD60Uu)

Fish Speech 1.5 supports portuguese, why don't you try that? [https://huggingface.co/spaces/fishaudio/fish-speech-1](https://huggingface.co/spaces/fishaudio/fish-speech-1)

3 and 4 are never gonna happen, Meta so far has avoided open-sourcing their image-related models or audio models that could be used to clone other people's voices.

Train an LLM on musical ABC notation and music theory, and make it actually good. Basically what the ChatMusician guys did: [https://huggingface.co/m-a-p/ChatMusician](https://huggingface.co/m-a-p/ChatMusician) But trained on actually good stuff and different genres, not just ancient folk songs. My recommendation would be using Omnizart on free public domain songs from different genres (check FMA for example) to generate MIDIs out of the different vocal and instrumental tracks, convert them to ABC notation and build a huge dataset on ABC notation, carefully curating it. Bonus if you guys can train a TTS model that sings, like some devs in China did with DiffSinger, by making a TTS model that takes lyrics, notes, phonemes, and duration for each phoneme.

Which settings are you using for RAG? I am not getting accurate results

Since you seem to, ahem, have knowledge specifically about that, can you tell us whether the API prices will be competitive against GPT4 and Claude Sonnet?

> SOTA open-source VLLM That's a huge claim. Post benchmark numbers vs internvl 1.5 or MiniCPM

Yeah... I would like to know how that fares against InternVL-Chat-V1.5