Decent enough for a model 50 times smaller than ChatGPT. I use orca_mini_3b.
Decent enough for a model 50 times smaller than ChatGPT. I use orca_mini_3b.
Compile llama.cpp, download a small GGML LLM model and you will have a quite intelligent assiatant running into your phone.
Can we say genocide already?