llama.cpp
The industry-standard C++ inference engine for high-performance, local LLM execution across all hardware architectures.
Just now
Has API
PricingFree
Free
Quantized LLM Inference
Model Fine-tuning (LoRA)
Text Embeddings
AI-Ranked Results
Grammar Constrained Sampling Tools
Discover the strongest tools and workflows for grammar constrained sampling.
1 tools foundFree tools displayed firstSorted by rating
Filter Results
Matching Tools (1)
AI Infrastructure