// TAG: LLAMA.CPP

Understand the landscape of on-device AI agents and tiny LLM systems, set up your development environment, and explore core tooling for edge AI.

Learn how to integrate a tiny, quantized Large Language Model (LLM) directly onto an edge device for natural language understanding, enabling …

Connect on-device Speech-to-Text (STT) output to a local TinyLLM for intent recognition and entity extraction, forming the core of your AI agent.

Step-by-step tutorial: Run MTP LLMs with llama.cpp & vLLM. By the end of this tutorial, you will be able to set up and run Multi-Token Prediction …

Explore and build three distinct on-device AI agents—a voice assistant, a data summarizer, and an anomaly detector—using tiny LLMs and modern edge …