I evaluate voice and chat agents end to end at Microsoft: simulate real customers, score every conversation, and find out why agents fail.

Simulated customers that call and chat with deployed agents, the way real customers do.
Metrics anchored to expected outcomes and grounding data, not vibes.
LLM judges that give the same answer twice, audited before they are trusted.
Tracing every failure back to why the agent failed.
Building the evaluation systems for Dynamics 365 Contact Center AI agents: simulation, scoring and failure diagnosis.
Demand forecasting across Azure data centers; production runtime from 7 minutes to 1.
Fine-tuned Llama-7B; built and evaluated a RAG course assistant with an LLM judge.
Patient chatbot with 1,000 weekly users; message classifiers deployed into the health record system.