Moxie goes local | TheaterFire

[-]

uhuge@reddit

also llama.cpp instead of "localLlama"?

Reply

[-]

aseichter2007@reddit

While it's hot and fresh, consider adding koboldcpp support. It's an all on one local inference that supports stt, tts, llm, images in and out. Koboldcpp is awesome.

Reply

[-]

Over-Mix7071@reddit (OP)

I’ll check it out, I need something quick for the legs and the ryobot running OrangePI Ultra. Maybe a Hailo too if it works.

Reply

[-]

YearnMar10@reddit

If you got a jetson Orin nano super, you probably would have the best portable there is right now for these things.

Reply

[-]

Over-Mix7071@reddit (OP)

I agree! A little power hungry and out of my budget. I have a couple nanos and a panda but the Opi seems to outperform both, I was going to try fitting a Hailo. But an AGX Orin would be nice!

Reply

[-]

Humm, I don’t get your response. If you already have some nanos, how can they be over your budget? Do you mean the old nanos? The nano Orin super is vastly superior in LLM inference speed. I don’t know about power drain for the Opi, but the nano needs 6.5W in idle (incl SSD, 5 without SSD), and probably 15 watt max for your use case.

Reply

[-]

Over-Mix7071@reddit (OP)

Yeah i have the old nano, another m2 for a drive would be cool too, I’m definitely gonna look at the orin

Reply

[-]

YearnMar10@reddit

I got a nano here and it can run gemma3 4B, faster whisper small and some rather unknown tts (IMS Toucan, about 1.5-2gig) simultaneously. I keep on struggling with the tts (for English there are plenty…), but if you’d use Kokoro, Kitten TTS, 2cent tts or any other smaller tts model you can even have more things running. If you want some of the „better“ tts models in real time like chatterbox, Orpheus or Higgs, then you’d need to use the agx Orin (or the upcoming NVIDIA Thor), but if you’re happy with the smaller models, the nano is just fine.

Reply

[-]

Awwtifishal@reddit

Koboldcpp has supports for multiple APIs. If your project can use OpenAI, it already works with koboldcpp. Same with llama.cpp.

Reply

[-]

aseichter2007@reddit

I assume you already know how James Brunton does his legs? Those things look solid for the application.

Reply

[-]

HeadOfCelery@reddit

What are those robot legs in the background?

Reply

[-]

Over-Mix7071@reddit (OP)

That’s Lil’green. My primary project right now. Training is going good. About ready for the sim to real jump.

Reply

[-]

Equivalent-Stuff-347@reddit

I wish you good luck and Godspeed As always, “mind the gap” :)

Reply

[-]

CattailRed@reddit

"Choice of Robots" vibes.

Reply

[-]

drplan@reddit

I can't express how much I love this.

Reply

[-]

Elvarien2@reddit

Whilst the little chatbot is cute and all. Absolutely stealing the spotlight is that biped walker casually standing in the background. What's it's story ?

Reply

[-]

Over-Mix7071@reddit (OP)

https://preview.redd.it/am1bavbvufjf1.jpeg?width=3024&format=pjpg&auto=webp&s=e5db0884da77c58d3869641d40f0aa82b2b002d9 Thats lil’green. He’s almost ready to start walking around the house.

Reply

[-]

Elvarien2@reddit

lil green looks like a badass. Should be fun once he's ready to walk around : )

Reply

[-]

Over-Mix7071@reddit (OP)

https://preview.redd.it/imd7p6zfvfjf1.jpeg?width=3024&format=pjpg&auto=webp&s=d361cbd013dfc452bb079b8b7bda3c05dd04f098 Running ROS2

Reply

[-]

Over-Mix7071@reddit (OP)

https://preview.redd.it/erognjvbtfjf1.jpeg?width=3024&format=pjpg&auto=webp&s=305624afa6ea0631b6ca734f6474632f3308103b Lil’green he’s almost ready to start walking around the house

Reply

[-]

WithoutReason1729@reddit

Your post is getting popular and we just featured it on our Discord! [Come check it out!](https://discord.gg/PgFhZ8cnWW) You've also been given a special flair for your contribution. We appreciate your post! *I am a bot and this action was performed automatically.*

Reply

[-]

hideo_kuze_@reddit

I clicked on this thread without knowing anything about moxies So this is a robot sold by a company that is going bankrupt. Is there an open source version of this robot? With the CAD model files and the like related: /r/MoxieRobot/comments/1i3mcei/openmoxie_lives/ https://github.com/jbeghtol/openmoxie

Reply

[-]

Over-Mix7071@reddit (OP)

Sadly no cad files. But I have torn one down and it must have cost a mint to manufacture

Reply

[-]

Over-Mix7071@reddit (OP)

Sadly no cad files. But I have torn one down and it must have cost a mint to manufacture I got mine on OfferUp. Firmware update is out there. But I don’t speak Android APK and scared I’ll brick her

Reply

[-]

tillybowman@reddit

how does the display work?

Reply

[-]

IrisColt@reddit

This is pure “the future is now” energy... thanks!!!

Reply

[-]

tailslol@reddit

m3gan?

Reply

[-]

Alienanthony@reddit

Can you show other things on its face?

Reply

[-]

Over-Mix7071@reddit (OP)

I’ve been trying to get access to the face and the camera feed. But the in firmware looks like the face is generated by another model. You can add stuff like hair and glasses

Reply

[-]

Alienanthony@reddit

Damn. This thing would be awsome to hook up in a serious setting if you could have it display charts on its face, a clock, percentage rates and such. I'd hook it up to factorio gameplay so I could say "how's the factory looking today pall?" And it would spit back statistics on its little face. Blinking back and forth between pictures depending on what it's saying.

Reply

[-]

Over-Mix7071@reddit (OP)

That would be dope. I was gonna use it as a security bot. I expanded the firmware but I don’t have the Android chops. I got one in pieces I’m down to experiment on

Reply

[-]

Alienanthony@reddit

Haha. A security bot huh? I could see it being used in a comedic scene where you try to have it distract a robber long enough to be arrested without telling the robber the bot already called the police.

Reply

[-]

Over-Mix7071@reddit (OP)

I just saw this… https://www.reddit.com/r/MoxieRobot/s/UM8tXXtiz8 not sure if it will boot afterwards

Reply

[-]

Alienanthony@reddit

Idk if I would flash it. It does seem like it's just a android app. If only we could get access to the software that's on it you can replicate it. Or at least understand how it talks to the motor system.

Reply

[-]

Over-Mix7071@reddit (OP)

I found some of the code and drivers for the motor controller. has a another board called lizard controller for motors https://preview.redd.it/2h2z9s877fjf1.png?width=2173&format=png&auto=webp&s=15f4fb8fc23c239d18040d90094fe16f7bdf2726

Reply

[-]

Alienanthony@reddit

Then I don't see why you couldn't just make an app for it. I wish you the best of luck, my dude. Can't wait to see what you make of it.

Reply

[-]

Over-Mix7071@reddit (OP)

I’m not super familiar with android file system I have firmware I can share if you want to give it a go.

Reply

[-]

Alienanthony@reddit

Trust me, neither am I. Thanks, tho. I don't own one of these and have enough projects on my shoulders as is.

Reply

[-]

LoveMind_AI@reddit

I didn't realize this wasn't something just in Meagan 2.0!

Reply

[-]

-Akos-@reddit

That’s cool! What hardware is it running on?

Reply

[-]

Over-Mix7071@reddit (OP)

The robot is on a rockchip 3288, the STT and Llama are on an old Lenovo thinkcentre mini m900 w/32gb ram (cpu only) and intel graphics pretty crazy

Reply

[-]

Echo9Zulu-@reddit

Have you tried OpenVINO? Ttft might be faster, throughput as well. Also, really cool homelab!

Reply

[-]

-Akos-@reddit

Awesome, thanks!

Reply

[-]

Over-Mix7071@reddit (OP)

I ran it on my workstation too. Amd 7950x3d / asus proArt rtx4080s / proart x870e./ 128gb ram It’s unreal fast with that model

Reply

[-]

ObjectiveOctopus2@reddit

We need an OpenJibo

Reply

[-]

cc413@reddit

I see you have the hal 9000 wearing [the wrong trousers](https://en.wikipedia.org/wiki/The_Wrong_Trousers) in the background there. I take it that's some sort of foreshadowing of whats to come in the next few weeks? If the robots take over I'm looking at you!

Reply

[-]

thrownawaymane@reddit

Yeah dude has half a Gundam in the background... we want to hear about that

Reply

[-]

ik-when-that-hotline@reddit

i saw a post by a professor on linkdein about using cheap cctv camera (that have motor) to use as base to make open llm powered robots.

Reply

[-]

chisleu@reddit

This is super fun. I ordered one of the hugging face robots and I'm hoping I can pull off something similar with a Mac Studio 512 GB powering the LLMs. I just finished building a kokoro powered API for TTS for my local agent. I'm having trouble wrapping my head around how STT works with the LLM as input. I imagine you have to have something recognizing that speech has started and stopped. What are you using? I don't want to have to press a button to speak either.

Reply

[-]