311+ curated AI tools and growing

llama.cpp

Local LLM inference engine running GGUF models on CPU/GPU.

API & ModelsLocalOpen source

About this tool

llama.cpp Local LLM inference engine running GGUF models on CPU/GPU.

A go-to option in API & Models, llama.cpp suits individuals and teams via its website or API integrations.

Open model hub with Inference API and Spaces deployment.

CLI to run open LLMs locally for self-hosting and developer integration.

AWS Nova multimodal foundation models for chat and content.

Ray-based model deployment and LLM inference platform.