solobsd
@solobsd@snac.solobsd.org
#OpenBSD -current now has a port of llama.cpp (misc/llama.cpp), an LLM inference library. I don't know what any of that means.
CPU backend only* for now, but Vulkan may be enabled in the future.
Please consult a doctor if your computer starts talking to you.
* This kills the planet.
https://marc.info/?l=openbsd-ports-cvs&m=173827745810949&w=2
@brynet I guess it's just a matter of time 'till OpenBSD gets our own Small Language Model named after an aquatic lifeform*
*superior to barnyard animals
@solobsd CloudInit timeout?