PyConf Hyderabad 2026

Small Models,
Big Impact

Why Your Next Production System Doesn't Need a GPT

Speaker Gokulavasan Murali
Event PyConf Hyderabad 2026
Track AI / ML

Frontier LLMs are powerful — but they're expensive, slow, and require an internet connection. This talk makes the case for Small Language Models (SLMs): models under 10B parameters that run entirely on your laptop, deliver real production results, and cost $0.00 per inference. We cover the full stack — from local inference runtimes to multi-agent pipelines — with five live demos running on Apple Silicon.

Local inference with MLX & Ollama
Structured extraction with NuExtract
Vision OCR with PaddleOCR-VL
Thinking mode — Qwen3.5 /think
Code generation on-device
Multi-agent pipeline with A2A protocol
Playwright browser automation
Cost comparison: SLM vs cloud LLM