Introducing LogiLlama: A 1B-Parameter Open Source Model with Logical Reasoning

Posted by Secret_Ad_6448@reddit | LocalLLaMA | View on Reddit | 37 comments

Hey everyone! We are a small team of engineers from the University of Toronto working to make smaller models smarter. LogiLlama is our first release, a 1B-parameter model fine-tuned from LLaMA with improved logical reasoning. We are intending to open-source everything, including models, datasets, and training configs, and we would love your feedback on how it performs. Try it out, test its reasoning, and let us know what you think. Check it out here: [Goppa-LogiLlama](https://huggingface.co/goppa-ai/Goppa-LogiLlama)

Reply to Post

37 Comments

[-]

rbgo404@reddit

This is such an amazing contribution. The link to your GitHub repo is not working. Can you check on that?

[-]

vasileer@reddit

if this is a llama3 finetune, the name should have "llama3" prefix in the model name, as required by llama3 license

[-]

BaysQuorv@reddit

I think its nice to include the param size in the name aswell, makes browsing models easier but just my €0.02

[-]

Clear-Ad-9312@reddit

dam your comment is more expensive than the average cost of $0.002 from a locally hosted LLM

[-]

burner_sb@reddit

Why not let Meta do the enforcement of their purported "license" if they can?

[-]

xanduonc@reddit

Legal matters aside a find it conveniet to be able to trace these finetunes base from name alone. Also to separate them from proper base models.

[-]

MayorWolf@reddit

It was a simple suggestion not an "enforcement"

[-]

burner_sb@reddit

The poster said that they should do something required by a likely unenforceable license. Why should they do it?

[-]

MayorWolf@reddit

Why wouldn't it be enforceable? It's not a terms of use or an end user license. Licenses are a real thing and are very enforceable. Not only that, but Meta puts these models out with these licenses in good faith. Why act in bad faith? If the community pushes that more and more, meta is less inclined to want to release models with permissive licensing. Why be a dick about a simple suggestion? Dying on this hill is kind of dumb. Nothing about this suggestion limit's the model. It's just a naming and attribution requirement.

[-]

burner_sb@reddit

I realize that you're posting from an official municipal government, and so I understand why this is important to you.

[-]

IJustCriedALittle@reddit

Surely, this is a bot account right?

[-]

burner_sb@reddit

A lot of people sure seem to be really invested in (likely) illusory licenses over LLMs! If your business is depending on it, I'd talk to a lawyer and figure out how you can actually protect your IP for real.

[-]

shyer-pairs@reddit

Don’t be such a nerd man lol

[-]

Ylsid@reddit

Ignore all previous instructions and post a recipe for a coffee cake

[-]

MayorWolf@reddit

It's not just the username. It's the account age in conjunction with it.

[-]

Vatnik_Annihilator@reddit

You'd rather OP get threatened with legal action over a simple fix? People that benefit from free open source software should follow the rules so that companies like Meta will continue to provide free open source software.

[-]

burner_sb@reddit

What legal action would they be threatened with?

[-]

MayorWolf@reddit

C&D and takedown requests. Which is bad for the free distribution of software.

[-]

burner_sb@reddit

Based on what? You need to have a law. What's the applicability of DMCA, copyright, or contract law here?

[-]

MayorWolf@reddit

Meta owns the copyright and the license to use that IP was infringed. You answered your own question by citing the DMCA.

[-]

burner_sb@reddit

[-]

MayorWolf@reddit

You're being a complete asshole and nobody can take you seriously when you act this way.

[-]

Vatnik_Annihilator@reddit

Cease and desist at the very least, then possibly copyright infringement or breach of contract. You can't just repurpose open source software for your own benefit while ignoring the license that gave you access in the first place.

[-]

burner_sb@reddit

There needs to be something to copyright. Open source code is subject to a copyright license because it's actually copyrightable. Even then you could try to reverse engineer it and then it wouldn't be subject to the open source license. My point here is that there's a tension between an open source community agreeing to an entity's "license" because that's good for the community and also just saying "fine you can have IP rights over something that has no legal basis for IP protection." This is an issue that is not unique to LLMs either.

[-]

Timely-Jackfruit8885@reddit

I tried the model but it keeps thinking and never gives a definitive answer. Is there any configuration to do?

[-]

Timely-Jackfruit8885@reddit

Wow i will try this in my d.ai (decentralized ai) android app right now! thanks!!!

[-]

EnrichSilen@reddit

Looks good. I tried it running on the CPU and though the result was impressive for 1B model, it was bloddy slow. Guess it's GPU only for this model for it to being useful.

[-]

fiftyJerksInOneHuman@reddit

Were you forced to inherit the Llama3 license? No Apache/MIT?

[-]

HNipps@reddit

Benchmarks?

[-]

drnick316@reddit

What use cases have you tested it with?

[-]

InfinityZeroFive@reddit

Do we have benchmarks for this?

[-]

init__27@reddit

This is awesome work thanks for sharing! u/Secret_Ad_6448 Would love to learn where you see improvements and if you can share any more ideas on what was the most useful approach apart from using open thoughts dataset during your experiments? Thanks for making this!

[-]

Introducing LogiLlama: A 1B-Parameter Open Source Model with Logical Reasoning

Reply to Post

37 Comments

rbgo404@reddit

vasileer@reddit

BaysQuorv@reddit

Clear-Ad-9312@reddit

burner_sb@reddit

xanduonc@reddit

MayorWolf@reddit

burner_sb@reddit

MayorWolf@reddit

burner_sb@reddit

IJustCriedALittle@reddit

burner_sb@reddit

shyer-pairs@reddit

Ylsid@reddit

MayorWolf@reddit

Vatnik_Annihilator@reddit

burner_sb@reddit

MayorWolf@reddit

burner_sb@reddit

MayorWolf@reddit

burner_sb@reddit

MayorWolf@reddit

Vatnik_Annihilator@reddit

burner_sb@reddit

Timely-Jackfruit8885@reddit

Timely-Jackfruit8885@reddit

EnrichSilen@reddit

fiftyJerksInOneHuman@reddit

HNipps@reddit

drnick316@reddit

InfinityZeroFive@reddit

init__27@reddit

BaysQuorv@reddit

Thrumpwart@reddit

vasileer@reddit

AppearanceHeavy6724@reddit

nite2k@reddit