Stop Guessing: Build Feedback Loop for Prompt Engineering

Tadas Goberis

Most teams iterate on prompts by eyeballing outputs and hoping for the best. This talk presents a different approach: connect your prompt to a measurable downstream outcome, build a test set, and let metrics drive improvements. I'll walk through a complete feedback loop - from prompt to retrieval metrics to automated error analysis to LLM-powered iteration - and show how this turns prompt engineering from guesswork into something you can actually measure and improve systematically.