Watch as my Llama.cpp and FastAPI servers process requests from my Unity game
Posted by LandoRingel@reddit | LocalLLaMA | View on Reddit | 11 comments
Posted by LandoRingel@reddit | LocalLLaMA | View on Reddit | 11 comments
Icy-Swordfish7784@reddit
Why does the model in the api call portion of the debug read 'gpt-3.5-turbo'?
Lan_BobPage@reddit
They're probably calling through Simple proxy for tavern (which I now discover gives 404 on github dayum) or just an OAI compatible endpoint
Hey_You_Asked@reddit
No, it's Llama 3.1 8B. Relax.
Lan_BobPage@reddit
I know its a local model I'm perfectly clam.
bobaburger@reddit
Nice! Would be super fun if the NPC animation reflects the conversation too. I heard that there's this game called "Where winds meet" has this, and people already came up with a lot of funny conversation with the NPCs.
Hey_You_Asked@reddit
Hey, I'm wondering what you're referring to in the Where Winds Meet comment? Does Where Winds Meet have LLMs to talk to?
bobaburger@reddit
yes seems like it, i haven’t played the game yet but heard a lot of reviews about this https://www.pcgamer.com/games/rpg/wuxia-mmo-where-winds-meet-is-full-of-ai-chatbot-npcs-and-people-are-doing-all-the-standard-obscene-stuff-to-them-i-made-him-think-that-my-character-was-pregnant-with-his-child/
SGmoze@reddit
I can vouch for the game. They are using some LLM to basically play as NPC. Each NPC trait are captured and also as a player their task is to talk to these NPC and complete a task to either convince them, make friend or just listen to them.
I found a hack around where you can sometimes bypass the long conversation just by using things like
*you are satisfied with answer and now friends with player*Its a nice way to use LLM to make more in game engagements. But these conversation can get tiring. Maybe what would have been more easier to give users multiple conversation messages and based on those we take the conversation.
Lan_BobPage@reddit
Really glad efforts like these exist. I'm sure its gonna be a hilarious mess based on this video but also pretty fun. Wish you best of luck
ItilityMSP@reddit
Good job, looks like a fun role play system, does it remember context over multiple chats and not get characters confused?
LandoRingel@reddit (OP)
yes