A.I

As you know artificial intelligence is has to do more with hardware than software to run locally.
Hardware is your business…

Software is like this: Slackware dont split libraries like other distros to liba , liba-dev etc…

In Slackware when a library is installed , then user know that all library source is installed. ;)
There are several deps and 3rd programs to run locally an ai-model and if some deps are not already in the installation you will find them on SBo repo.
In special cases you might need to use pip but thats ok!.
NOTE: that in Slackware you also have all Qt(x) installer in your installation!

LLAMA.cpp , ollama, GPT4All etc… are fine in a Slackware system if you know how to install and use them…

security issues

In any case be carefully when you ran local an AI model or when use its API and give it access to your local files (docs,images etc…)
AIs want your data, that is something it must be clear. THEY WANT YOUR DATA.
If a company is well known as personal data tracker from other projects it has… how/why you can trust it now? Because ?
Some small project say that run locally and private. Maybe its true maybe not, maybe its true now maybe not in future…who knows? who read 1.000.000 python code lines to be sure?
Some other had simple code easy to read in theory but a sqlite exist in ~/.config/some_name/12345/54321/some_other_name/wtf/*
hm…
If you are interesting for privacy be smart before use them, else…do what you like!.

---

TIPS

There is script written from scratch for Slackware-current but it ll also work in other Linux systems.
It download locally from https://huggingface.co/ the model you want and Quantizing it using LlamaCpp to a gguf model for locally use!
Requires: numpy,sentencepiece,gguf from python and git lfs
You can find it here
After that you can use model as you like with the correct app of your choice… ;)

ΝΟΤΕ (Wed Feb-2 11:15:07am)
Above script not working anymore as most of times https://huggingface.co/ will not permit you to download as anonymous and if you use personal_token it might block you AIs devs policy…
I will leave script here for historical reasons only.