Llama.cpp

GGML

LLM inference in C/C++ with minimal setup and state-of-the-art performance.