karimaballanews

The weekly · Week 14 · 30 Mar – 5 Apr 2026

AI coding agents: what changed

This week highlights advancements in foundation model infrastructure and observability, featuring DSPy for programmatic prompting, Meta Llama reference recipes, Xinference distributed inference, and OpenLLMetry instrumentation for AI agents.

4 picks

01GitHub★ 24,800

DSPy programmatic framework for foundation models

Framework that replaces heuristic prompt engineering with declarative modules and automated teleprompter optimizers to maximize agent pipeline accuracy.

Image: GitHub

03GitHub★ 6,400

Xinference distributed model inference engine

Xinference is an open-source serving system designed for running LLMs, embedding models, and multimodal architectures. It operates on CPU, GPU, and heterogeneous hardware clusters.

Image: GitHub

Picked from public sources (GitHub, Hacker News, DEV, Lobsters, Reddit, Product Hunt) by our daily scout. Each summary uses only what the source itself says; GitHub stars are as checked on the date shown.