Official Technical Resources: Microsoft (page 13)
Official Technical Resources · Microsoft: 312 entries in total; this page lists entries 181–195.
Introduction to cloud evaluation with Microsoft Foundry SDK
Set up the Microsoft Foundry SDK and choose a cloud evaluation workflow for datasets, targets, interactions, conversations, or synthetic data.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Evaluate conversation datasets with Microsoft Foundry SDK (preview)
Learn how to use the Microsoft Foundry SDK to evaluate complete conversation datasets at the turn or conversation level.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Evaluate existing datasets with Microsoft Foundry SDK
Learn how to use the Microsoft Foundry SDK to evaluate JSONL and CSV datasets with uploaded or inline data, schemas, and evaluator mappings.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Evaluate deployed model and agent conversations with Microsoft Foundry SDK (preview)
Learn how to use the Microsoft Foundry SDK to evaluate traced production conversations by conversation ID or agent filter.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Evaluate individual interactions from deployed models and agents with Microsoft Foundry SDK
Learn how to use the Microsoft Foundry SDK to evaluate deployed agent and model interactions by response ID or Application Insights trace.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Get evaluation results with Microsoft Foundry SDK
Learn how to poll cloud evaluation runs, interpret results, review model-target latency and estimated cost, cancel runs, and troubleshoot errors.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Simulate conversations with the Microsoft Foundry SDK (preview)
Use the Microsoft Foundry SDK to generate simulated conversations from scenarios and evaluate agent behavior.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Generate synthetic evaluation data with Microsoft Foundry SDK (preview)
Learn how to use the Microsoft Foundry SDK to generate synthetic evaluation queries for model and agent targets.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Evaluate model and agent targets with Microsoft Foundry SDK
Learn how to use the Microsoft Foundry SDK to evaluate model, prompt-agent, and hosted-agent targets with responses and invocations protocols.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Analyze evaluation results with cluster analysis (preview)
Learn how to run and interact with an evaluation cluster analysis.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Evaluate your AI agents
Learn how to evaluate AI agents using built-in evaluators for quality, safety, and agent-specific behaviors.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: LLM Observability and Tracing · Model Deployment Options
Link last checked: 2026-09-24
Evaluation dataset schema in Microsoft Foundry
Learn the standard fields and supported shapes for turn-level, conversation-level, agent, and simulation seed evaluation datasets.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Generate a synthetic evaluation dataset (preview)
Generate Simple Q&A and simulation seed datasets in Microsoft Foundry from an agent, prompt, or reference file for single-turn and multi-turn evaluation.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Evaluation datasets in Microsoft Foundry
Learn how evaluation datasets are structured, how to prepare them, and how Microsoft Foundry uses them in evaluation runs.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: Model Evaluation and Benchmarks · Large Language Model (LLM)
Link last checked: 2026-09-24
Monitor agents with the Agent Monitoring Dashboard
Learn how to monitor operational metrics, token usage, latency, and evaluation results for AI agents in Microsoft Foundry by using the Agent Monitoring Dashboard and Application Insights.
Evidence use: For understanding, implementation, selection, reliability, security or migration decisions.
Limitations: Directly evidences only Microsoft's own implementation and claims. Recheck preview features and product lifecycle before use.
Related concepts: LLM Observability and Tracing · Model Deployment Options
Link last checked: 2026-09-24