How Copilot works behind the scenes
When you ask Copilot a question inside Microsoft 365 (whether that’s in the Copilot app, Outlook, Teams, Word or elsewhere) it doesn’t go off and “learn” from your data.
Instead, it follows a structured, controlled process.
Step 1: You ask a question
For example, you might ask Copilot to summarise recent emails and Teams chats with a colleague and highlight any outstanding actions.
Step 2: Copilot gathers relevant context
To answer you accurately, Copilot needs context. It gathers this using Microsoft Graph, which is the same system Microsoft 365 already uses to power search, recent files, shared documents and activity insights.
This step is called grounding.
Crucially:
- Copilot can only access data you already have permission to see
- It cannot see other users’ content or anything you wouldn’t normally be able to open yourself
This permission model hasn’t changed with Copilot and it’s the same security boundary Microsoft 365 has always enforced.
What role the AI model plays
Once Copilot has gathered the relevant information, it sends the following to an AI model:
- Your prompt
- Your chat history (if you’re asking a follow-up question or clarification)
- The supporting context (for example, relevant emails or chats)
- A system prompt (which tells the language model how to behave and what constraints to follow)
The model’s job is not to search for data or discover new information. Copilot has already done that. The model simply:
- Reasons over the information it’s given
- Summarises it
- Rephrases it
- Highlights what’s important
This is what large language models are designed to do.