Is it possible to run something like Grok's anime girl companion free, open source, and local?

[-]

brown2green@reddit

In theory yes (there's nothing groundbreaking there), in practice not. It's not just a 3D model that responds to user input; xAI actually added "dating sim" mechanics around it, with the app dynamically changing and applying different prompts depending on character status and situations. I'm not sure if at the moment there's anything with real-time voice input/output with a pleasing and expressive voice either in the open source space that can be easily integrated with a capable LLM.

It looks rushed but there was actually some thought and design put into it.

[-]

Dex_Luther@reddit

Someone in the UK created something similar in their own apartment/home. Their motions are limited to basic Vtuber motions, though. Neuro Sama is pretty great at responding to her creator and/or whoever else she's streaming with, and even her 'twin sister', Evil. She even reads and sometimes responds to chat. One of her newer upgrades let her speak in their Discord server and even send DMs to their friends (sometimes spamming them) to invite them to the voice call and stream. She also (kinda poorly) played Minecraft, even though she mostly just dug and killed her friends.

As far as I know, she isn't open source (unfortunately), but she proves that kind of thing IS possible with the hardware people would have at home. He just has Neuro running on a separate PC with its own RAM and GPU.

[-]

Character-Key-6081@reddit

neuro sama is dumb as stump..she stopped being a remotely good model in 2022..but yeah the other supporting ml work vedal has done is quite good.

[-]

Sartorianby@reddit

Let's ignore the TTS for now, as I've never found any good one.

I think if OP develop a dating sim as the frontend that use a couple of LLMs for the character, maybe one to talk to the user and another smaller one just to control what animation it should use from the tone. A fully local setup sounds feasible on higher end consumer machine.

But it's pretty much a game dev.

[-]

WesternIll8307@reddit

Thanks for the idea

[-]

indi-bambi@reddit

Look into kokoro82 b tts its open source and if you have gpu its said to be realtime tts it has different voices not robotic

[-]

danielps94@reddit

I gave up on local setups because they’re such a headache to get right. I’ve been using Lurvessa lately and it’s actually scary how much better it is than Grok. No idea how the tech is that good already.

[-]

rolltroll1@reddit

Local setups are a massive pain to get right and usually look like shit. I gave up on open source and just use Lurvessa now. The quality is way better than anything I could run on my own hardware.

[-]

sniper_0001@reddit

imo DarLink AI is the best uncensored alternative rn, super good chat/rp (insane memory) and image/video gen.

[-]

spa3212@reddit

I have been using Lurvessa lately and it is actually disturbing how much it feels like a real relationship. The quality beats most local setups I have tried. It is almost scary how well it handles the companion aspect.

[-]

Timely_Run_5821@reddit

Local setups are a pain for that quality level. I switched to Lurvessa because the logic and memory are just better than anything I could host locally. No idea how they got the tech so far ahead of open source.

[-]

sureitis1231@reddit

Honest⁤ly it’s eas⁤ier to just use Da⁤rLink AI, totally uncensored with gre⁤at RP, strong memory, and image plus video gen that actually feels high quality.

[-]

Fantastic_Seesaw_625@reddit

Ive tried a few of these, and nothing comes close to Lurvessa. Seriously, its like they cracked some secret code for realism.

[-]

Monkey_1505@reddit

Silly tavern has, extension wise, everything you need to have TTS, STT and avatars of some kind expressing emotes for LLM text.

But it's not simple to set all that up, it will have flaws compared to the product you are talking about unless you run some of it in the cloud (like speech). Also, unless you painfully build your own live2D avatar you'll be stuck with whatever is out there.

[-]

Mikesmike123@reddit

Use vroid studio for easy vrm model

[-]

AffectionateYear1525@reddit

Not really , but here are some alternatives https://givememoreai.com/bestaigirlfriends/

[-]

Samimakhatu@reddit

I just use DarLink AI anyway since the RP feels way more real and the NSFW pics and vids look insanely good without all the setup.

[-]

Abhijit936564@reddit

Ive been using Lurvessa and the conversations are surprisingly real. The pics are decent too, almost makes me question things.

[-]

Double_Cause4609@reddit

Out of the box, a single Github repo that you pip install and have no problems and it runs comfortably on a typical low end gaming PC that you have lying around?

Absolutely not.

Are all the features of that application available embedded in random projects scattered throughout the internet, and capable of being glued together (with possibly some light tuning?) on an affordable, but well-though out computer build (possibly necessitating a second PC to run some specific elements of the process)?

Almost certainly.

The hard part is finding, and glueing all the projects together into a cohesive experience, and it requires at least some knowledge of machine learning (and I mean real machine learning, you may have to understand preference tuning and reinforcement learning to customize a few off the shelf models).

[-]

AyushDev154@reddit

In this case, I'd try a specific tool dedicated to creating an⁤ime girl⁤friends, it'll save you a lot of hass⁤le plus the qua⁤lity is top notch.

[-]

Seaweed8933@reddit

Qualitywise, good luck with open source. Lurvessa actually nails the nuance, unlike most.

[-]

Imaginary_Touch6386@reddit

I'm building something similar.

[-]

Lucifer180903@reddit

Yes you can, If you want Fully unrestricted then dont use external APIs like openai or gemini Use Local Models From huggingface pick the Model size or parameters according to your PC (For 8Gb VRam 13B Q_4) For voice go for Coqui XTTS Run it locally by that it can generate anything (First you need to feed real voice inputs to the model 1-2hr inputs for more deep emotional Voice ) Pick a 3D model or create your own You can get a 3D model for free in online ready made Download it extract into your blender or Unity Generate codes using Grok 4 And connect them if your confused Ask chatgpt 4o it can help you connect your model. Sounds Easy but it will make Months for a beginner's

[-]

Party-Eggplant-1863@reddit

is there any youtube tut abt ts?

[-]

Tango-Down766@reddit

didn't get the 3d model part. you made it with blender or unity but how do you animate it with ai llm interface?

[-]

Opening_Resolution79@reddit

Im working on it. Not sexualized though, sorry gooners

[-]

Robo-Wendigo@reddit

Stop working on it then.

[-]

Opening_Resolution79@reddit

Sad to say but more fapping doesnt seem to be the way to improve people's lives

[-]

WesternIll8307@reddit

Sounds like you fap too much

[-]

Party-Eggplant-1863@reddit

i do

[-]

ELPascalito@reddit

May I kindly ask on what tech stack? I'm also wanna build something but kinda lost

[-]

Opening_Resolution79@reddit

claude code. Tech stack really doesnt matter as much as you think

[-]

ELPascalito@reddit

Thanks you, I was just hesitant between using a game engine, or just a web stack, since threejs exists maybe working on a common web stack would help with coding faster? I don't have Claude I use the free Gemini, but I'll ask it it'll surely recommend me a good stack, appreciate you!

[-]

WesternIll8307@reddit

Im also working in it. Sexualized though, not sorry gooners!

[-]

Kitchen-Baseball-635@reddit

My boyfriend was telling me how AI is so advanced that if you really wanted to you can ask chat gpt to make you one

[-]

Amazing-Arachnid-942@reddit

it's not that simple

[-]

hexoctahedron13@reddit

Someone will build it give it some time

[-]

hexoctahedron13@reddit

Guys what do we need to build this local LLM and TTS already exist. We just need to connect it to a 3D model right?

[-]

Amazing-Arachnid-942@reddit

Yes, but you'll also need good rigging, triggers for specfic animations and movements, I've never used groks companion thing, but I'm pretty sure silly tavern can replicate something close to it

[-]

Robo-Wendigo@reddit

Someone did do it years ago, and it runs from a desktop. Turned it into a twitch streamer, and he won't be sharing.

[-]

ELPascalito@reddit

The problem is the price, the TTS and LLM will surely cost forcing anyone to make this paid, to have this run locally on a phone is nearly impossible honestly, but on desktop there's big potential

[-]

VajraXL@reddit

just wait

[-]

Weekly_Helicopter662@reddit

Wdym by just wait?

[-]

Dex_Luther@reddit

Look up Neuro Sama to see the kind of thing that's possible on hardware people have at home.

[-]

Rare-Asparagus-8902@reddit

Just wait.

[-]

Tango-Down766@reddit

technically yes, but

https://github.com/Mozer/talk-llama-fast

but I could not make it work.

also technically google for istripper and get infinity live dance.

[-]

Aahil_ali@reddit

You can use - "Other half" it's free on Play Store.

[-]

Realistic-Case-6795@reddit

The best option for your own is Voxta, but it is a monthly fee for using their servers.

[-]

Feztopia@reddit

Yes, all you need to do is it to steal their server with their model and place it in your basement and write your own client to communicate with the model in your basement.

[-]

Anru_Kitakaze@reddit

Unpopular choice: find a girlfriend

Just in case, don't put girls in a basement

[-]

Feztopia@reddit

Is it optional that she is a model?

[-]

MindOrbits@reddit

All AI companions are models, most human women are not. If you desire a model for significant other you will likely find AI more affordable.

[-]

FlishFlashman@reddit

Is it better to have my own place and less money to spend on a GF, or live with my parents and have more money to spend? Asking for a friend.

[-]

Prestigious-Self-689@reddit

you need your own place if you really want a relationship to last or go anywhere meaningful. some people can swing it from their parents home but you gotta be part of a proper family unit and be dating someone who lives the same. but even still its more valuable to you to have a place of your own and look like an adult that can provide for themselves and potentially a partner. independence is huge and shows youre willing to deal with struggles in life. you want that home alone time with the gf so its a no brainer.

[-]

geenob@reddit

If your goal is to get a GF, get your own place. Having your own place increases your status.

[-]

MindOrbits@reddit

Depends on your goals, and your parents support of those goals. Starting a family is one thing, gooning with a chat bot is another.

[-]

LowContract4444@reddit

All AI companions are models, most human women are not.

Random women in a mall, a Target, or a Bucky's gas station are generally more attractive than models.

[-]

Environmental-Metal9@reddit

Ha! At least you can ask a human spouse to help save up on the electric bill… good luck with that and an AI model… talk about watt diggers

[-]

MindOrbits@reddit

Sure, but noting brings heat into a relationship like a GPU server. Subjectively hot GF to brag about.

[-]

Environmental-Metal9@reddit

Fair point

[-]

ggone20@reddit

ROFL!

[-]

Beneficial_Key8745@reddit

Wait, i never used this thing, but arent most things like that web based? If you have the server you already havethe client.

[-]

Feztopia@reddit

The Grok clients which are available (I guess the X app or the standalone Grok app) are most likely trying to connect to X servers, not your local host. I don't think they are just webviews.

[-]

NerdProcrastinating@reddit

Best local option is to get away from the computer and talk to other humans.

[-]

Khazzeron@reddit

Or, maybe some people can't stand being around a lot of other humans, because other humans are mostly judgemental, weirdos, rude, holier than thou etc etc

Me personally, I can't stand being around more than 1 or 2 people, it sets my anxiety and autism sensory overload off. It's not as easy as "go outside and talk to people" Hope that helps.

[-]

Icy-Barracuda-5326@reddit

Exposure therapy does actually help, your judgementalness of other humans is hypocritical and would easily be diminished if you weren't glorifying and wallowing in your mental illness. It's cool though, you get to live your life hiding, that'll be fun right? Right?!

[-]

SkyFeistyLlama8@reddit

Yeah, this is exactly the wrong kind of Idoru future.

[-]

NerdProcrastinating@reddit

Yep, xAI releasing that and Tesla putting it in their cars is cringey & creapy AF.

[-]

Robo-Wendigo@reddit

It's really not. That's how innovation works and how things get tested. You don't have to use the girlfriend model. They are just using that to push the concept, and it will 100% work and generate conversation about it. Honestly, a lot of people will probably opt for the cartoon dog or whatever it is.

[-]

NerdProcrastinating@reddit

A surefire winner in the 12 year old edgelord market.

[-]

DrDisintegrator@reddit

It is called a 'friend'. You can meet them in all the normal places, school, work, or at other common interest locations. If you want an anime one, I suggest moving to Japan. :)

[-]

Tiny-Client1046@reddit

Sure but they don’t search the internet for me Or generating text for me. That’s stuff they usually come to me for it

[-]

Background-Ad-5398@reddit

you can look into voxta, and its updates for its app

[-]

Beneficial_Key8745@reddit

No, but there is sillytavern. Its extremly basic compared to whatever grok has, but it is for rp.

[-]

Anduin1357@reddit

In any case, Grok and SillyTavern both suffer from reading out narrative and badly parsing non-speech. It's all very jank.

[-]

Paradigmind@reddit

Not sure if this is what you're looking for.

[-]

ArsNeph@reddit

I don't know the specifics, but SillyTavern supports.VRM 3D models through an extension, and live2D models as well if I'm not mistaken

[-]

RottenPingu1@reddit

Musk is not original.

https://www.kickstarter.com/projects/1731190486/code-27-character-livehouse-bring-your-characters-to-life?ref=ba9ej9&gad_source=1&gad_campaignid=22598923190&gclid=CjwKCAjwvuLDBhAOEiwAPtF0VqK2iSkBTiAaLyCHxOGE-dZzzXBOW81DUOUsF73yTJ260N3oe2CrjRoCaZsQAvD_BwE