Beginner here, have some questions about hosting it on my hardware
Posted by Both-River-9455@reddit | LocalLLaMA | View on Reddit | 4 comments
I want to host one locally mainly for study purposes, as in feeding it my studying material and then receiving answers from what I ask.
I don't have particularly good hardware, just a humble gtx 1060 6GB edition.
I was following an instruction on how to install it and it showed me "weights", I do not understand what weights are here. Would love an explanation and would love to know how to download these without giving my information to Meta.
GizmoR13@reddit
What OS?
What you trying run with what?
Both-River-9455@reddit (OP)
Linux
LocalLLaMA-ModTeam@reddit
Rule 1 - Search before asking. The content is frequently covered in this sub. Please search to see if your question has been answered before creating a new post.
Skyline34rGt@reddit
How about go to youtube and watch about LmStudio - where you install it, search model - download, load and use...