Posts tagged "Testing"

4 articles on AJ's Tech Notes tagged with Testing.

  1. Testing .NET AI Apps with Microsoft.Extensions.AI.Evaluation

    Score model output in unit tests with Microsoft.Extensions.AI.Evaluation: the packages, a first relevance evaluation, how to assert safely, and rules for keeping an LLM judge repeatable.

    By Ajith Joseph · Tue Nov 03 2026 · #dotnet #csharp #ai #testing

  2. Copilot Studio Custom Graders: Write the Rubric Once, Reuse It in Every Evaluation

    Copilot Studio is adding a reusable library of custom graders, generally available November 15, 2026. How to write graders that earn their place and keep the rubric under version control.

    By Ajith Joseph · Fri Oct 30 2026 · #copilot-studio #testing #ai-agents

  3. Gate Copilot Studio Releases with the Evaluation API

    Run Copilot Studio agent evaluations from a pipeline with the Power Platform API, then block a release on regressions. A tested gate script, the auth caveats, and the pitfalls.

    By Ajith Joseph · Thu Oct 01 2026 · #copilot-studio #power-platform #testing #ci-cd #ai-agents

  4. Your Copilot Studio Agent's Model Will Change Under You: A Change-Management Playbook

    Copilot Studio upgrades default models and retires old ones. A tested playbook to pin, evaluate, compare runs, and diff exported results so a model change never surprises you.

    By Ajith Joseph · Tue Sep 29 2026 · #llm #copilot-studio #testing #ai-agents