Abed Matini

Senior Backend Developer at Ogilvy

Abed Matini is a Senior Backend Developer with a strong background in information technology engineering. He specializes in building scalable backend systems and integrating artificial intelligence to create smarter, user-focused applications. His expertise includes generative AI, prompt engineering, and developing AI-powered applications. Abed is passionate about exploring the convergence of backend development and AI technologies to drive innovation in intelligent software solutions.

Stop Paying for Easy Prompts: Architecting Hybrid Local-to-Cloud AI Systems

Are you paying premium API token rates for a state-of-the-art cloud model just to summarize a three-line email or parse basic JSON? As AI integration becomes standard, relying exclusively on cloud LLMs is becoming an expensive, high-latency bottleneck. This session explores the pragmatic shift toward Hybrid AI Architectures. We will dive into how developers can harness the idle compute power sitting on their desks to handle lightweight generative tasks, reserving expensive cloud models (like Gemini Pro or Claude) strictly for heavy reasoning. In this talk, we will cover: The Tech Stack: Setting up local execution engines (Ollama, Llama.cpp) and open-source gateways (LiteLLM). Dynamic Routing & Fallbacks: How to implement intelligent routing layers (like RouteLLM or Semantic Router) to intercept prompts and mathematically decide if they should be processed locally or in the cloud. Edge Pre-processing: Using local SLMs (Small Language Models) for PII redaction and document summarization before data ever leaves your network. Attendees will leave with a clear, actionable blueprint and the open-source tooling needed to slash their AI infrastructure costs without sacrificing output quality.

Cape Town

AI