Decent enough for a model 50 times smaller than ChatGPT. I use orca_mini_3b.
Compile llama.cpp, download a small GGML LLM model and you will have a quite intelligent assiatant running into your phone.
I still don’t understand why the developer does not consider the option of adding a custom API key
Can we say genocide already?