Skip to content

Blog about agents evals - #976

Open
PaoloPia wants to merge 8 commits into
mainfrom
staging
Open

Blog about agents evals#976
PaoloPia wants to merge 8 commits into
mainfrom
staging

Conversation

@PaoloPia

@PaoloPia PaoloPia commented Aug 3, 2026

Copy link
Copy Markdown
Collaborator

No description provided.

PaoloPia and others added 8 commits August 3, 2026 12:28
Blog about agents evals
… design

Path 1 (BMA) - migrate from Semantic Kernel to Microsoft Agent Framework:
- AzureAIAgent -> AIAgent/FoundryAgent, InvokeStreamingAsync -> RunStreamingAsync,
  threads -> AgentSession, AddKernel() removed
- Foundry agents are now resolved by name instead of id (AgentName config)
- Citations surfaced via CitationAnnotation
- Add per-lab complete solutions: BMA2/BMA3/BMA4-complete

Path 2 (BAF) - shorten the track from 8 labs to 4, focused on grounding:
- BAF0 Prerequisites, BAF1 Build and Run, BAF2 Foundry IQ, BAF3 Work IQ
- BAF3 rewritten to be self-contained (includes the OBO auth previously in BAF5)
- Add BAF3-complete; retire the vision, policy search, communication and MCP labs
- Retired labs and their solutions moved to archive/ rather than deleted

Docs and design:
- Rebuild the start pages with the cc-widgets design used by the other sections
- Link The Microsoft IQ Series (aka.ms/iq-series) where Foundry IQ and Work IQ appear
- Remove UI screenshots that go stale quickly; steps are now self-sufficient in text
- Use the full "Microsoft 365 Copilot" product name throughout
- Update mkdocs nav, awards criteria, integrate page and the badge step registry

All eight sample solutions build with 0 errors. mkdocs --strict introduces no new warnings.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 7afbddd2-c09c-4d1e-8729-fa83dcf1d9da
- Indent fenced code blocks inside numbered lists so they no longer
  terminate the list and restart numbering at 1
- Show the appsettings.json addition as valid JSON instead of a
  fragment starting with a bare comma, plus the surrounding context
- Add missing language hints so blocks are syntax highlighted
- Strip trailing whitespace inside code blocks

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 7afbddd2-c09c-4d1e-8729-fa83dcf1d9da
- .devcontainer/custom-engine-agents with .NET 9, Azure CLI, DevTunnel,
  Node and the C# Dev Kit / Agents Toolkit extensions preinstalled
- Offer it as a tabbed setup option in Lab BAF0 alongside local install
- Drop the Azure Functions Core Tools step, which was only needed by the
  retired MCP lab, and realign the badge step registry

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 7afbddd2-c09c-4d1e-8729-fa83dcf1d9da
Azure Functions Core Tools was only needed by the retired MCP tools lab.
The current four-lab track never runs Azure Functions, so installing it
is dead weight. Realign the badge step registry accordingly.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 7afbddd2-c09c-4d1e-8729-fa83dcf1d9da
… design (#977)

Refresh Custom Engine Agents: Agent Framework, shorter BAF track, new design
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants