Open-source large language models, run locally on your CPU and nearly any GPU-Slackware

rizitis · 11-22-2023, 04:49 AM

I m using GPT4All last months in my Slackware-current.
Here is a SlackBuild if someone want to test it.
Its 100% private use no internet access needed at all.
Open Source app with a very friendly discord community.

bigbadaboum · 11-22-2023, 03:46 PM

me

Quote:

Tell me a joke about Patrick Volkerdy

GPT4All

Quote:

Why did Patrick Volkerding become a software developer?
Because he wanted to "Slack" off and create an awesome Linux distribution!

SlackCoder · 11-23-2023, 05:15 AM

Interesting... thanks for posting!

rizitis · 11-23-2023, 06:02 AM

Quote:

Originally Posted by SlackCoder

Interesting... thanks for posting!

I think you are coding in GoLang and python right?
If i m right, you can do amazing things here...

SlackCoder · 11-24-2023, 04:56 AM

Quote:

Originally Posted by rizitis

I think you are coding in GoLang and python right?
If i m right, you can do amazing things here...

Yes, indeed Golang but not python.

Will you consider releasing this through slackbuilds.org?

giomat · 11-24-2023, 05:02 AM

Cant wait to try this when I finally upgrade my machine

rizitis · 11-24-2023, 12:20 PM

Quote:

Originally Posted by SlackCoder

Yes, indeed Golang but not python.

Will you consider releasing this through slackbuilds.org?

I m not maintaining packages in SlackBuilds, there are a lot of personals problems keep me back...

I have some SlackBuilds in my github that probably it would be useful for other people also, if anyone want to build them the SBo way I have no problem, just remove my name from there and thats all...

For example this go SlackBuild I have no idea how to make it the SBo way?

TIP1: https://github.com/ggerganov/llama.cpp <-- READ and build this, the way you prefer, I build it only for CPU

Code:

make LLAMA_OPENBLAS=1

and then I use /path/to/llama.cpp/models/(here download for gpt4all models.gguf)

TIP2: This is 1 hour video , I think is the best simple but full explaining video about ai in web so far...

rizitis · 11-24-2023, 01:28 PM

Quote:

Originally Posted by bigbadaboum

me

GPT4All

plz look attachment or video

dchmelik · 11-28-2023, 07:30 AM

Quote:

Originally Posted by rizitis

[...]I have no idea how to make it the SBo way?

Just read SlackBuilds.org (SBo) and look for templates which show how. If you can't find, join Libera Internet Relay Chat (IRC) quasi-official ##slackware & official #slackbuilds and people will help, or ask here (I can link later). It's better to learn (and isn't hard) rather than say you want your name removed from your own work... if someone else puts it on SBo they can credit you.

brobr · 12-06-2023, 11:34 AM

Hmm, interesting. Sometimes spot on, sometimes messing it up completely....

brobr · 12-06-2023, 01:36 PM

and it matters what model is used...

dchmelik · 12-12-2023, 07:33 PM

I'd like to try this, but seems it has unlisted dependencies, like qt6? I was unable to compile qt6 from SlackBuilds.org (SBo).

brobr · 12-13-2023, 03:40 AM

Same here; see posts below https://www.linuxquestions.org/quest...ml#post6468716

Maybe try 6.6.1: https://www.linuxquestions.org/quest...ml#post6468925

EDIT: Same as rzitis: 6.6.1.builds ok

rizitis · 12-13-2023, 08:02 AM

Sorry i m on mobile and dont have access to pc ....
Deps are listed in slack-required file https://github.com/rizitis/GPT4All.S...slack-required

As for qt6 i will check tonight if building or not , idont know is this patch accepted on sbo? https://www.linuxquestions.org/quest...ng-4175730062/
If something else needed for qt6 i dont know , i will know when i have access to my laptop.

rizitis · 12-13-2023, 01:18 PM

qt6 6.6.1 from ponce repo builds fine for current