☆ Yσɠƚԋσʂ ☆ to MemesEnglish · 6 months agoUse The New Means And The Oldimagemessage-square49linkfedilinkarrow-up155arrow-down110
arrow-up145arrow-down1imageUse The New Means And The Old☆ Yσɠƚԋσʂ ☆ to MemesEnglish · 6 months agomessage-square49linkfedilink
minus-squaresudo_haltlinkfedilinkarrow-up2·6 months agoOn another note Ollama is really shitty and they’re trying to push their own API format, please consider using the one true community deriven gigachad Russian developed ‘llama.cpp’. KoboldCPP even has a nice web UI for use.
minus-square☆ Yσɠƚԋσʂ ☆OPlinkfedilinkarrow-up2·6 months agooh thanks for the heads up, I’ve heard of llama.cpp, but never bothered looking into taking it for a spin.
On another note Ollama is really shitty and they’re trying to push their own API format, please consider using the one true community deriven gigachad Russian developed ‘llama.cpp’. KoboldCPP even has a nice web UI for use.
oh thanks for the heads up, I’ve heard of llama.cpp, but never bothered looking into taking it for a spin.