Review Mastery and Ambient Learning
Review skill mastery, IRT analytics, ambient learning activity, nudges, and behavioral signal analysis.
Use this guide when you need to understand learner mastery signals or activity captured outside normal course completion.
Before you begin
You need analytics access and enough learner activity for meaningful signals.
Before reviewing mastery or ambient learning, confirm:
- Skills or competencies are mapped where mastery analysis is expected.
- Learners have completed activities that produce mastery evidence.
- Ambient learning and nudges are enabled for the organization where required.
- Privacy mode allows the level of user detail you expect to see.
Review learner mastery
Use Learner Mastery
Open Intelligence > Learners > Mastery to review skill mastery across the organization or team.
Tabs:
| Tab | Use |
|---|---|
| Overview | Skill mastery summary and gaps. |
| Diagnostics | Confidence-adjusted mastery and IRT analytics. |
Learner questions to the learning assistant are under Intelligence > Courses > Learner Questions.
The active tab is reflected in the URL with a tab parameter, so browser back
and forward can preserve the selected tab.
Use IRT Analytics
Open Intelligence > IRT Analytics directly or use the Diagnostics tab inside Learner Mastery.
IRT Analytics includes:
- Learners with IRT data.
- Practice sessions.
- Courses with practice.
- Learner table.
- Raw Mastery.
- Adjusted Mastery.
- Guess Rate.
- Skills.
- Responses.
- Expandable per-skill breakdown.
- Certification practice analytics.
High guess-rate skills are flagged. Use those flags to distinguish fragile mastery from stronger evidence of understanding.
If no IRT assessment data appears, learners have not completed IRT-calibrated assessments or certification practice sessions yet.
Review ambient learning
Use Ambient Learning
Open Intelligence > Ambient learning for bot interactions, TIL insights, nudges, and behavioral signal analysis.
Tabs:
| Tab | Use |
|---|---|
| Activity | Bot activity and event types. |
| TIL Insights | "Today I Learned" insight feed. |
| Nudges | Nudge delivery, engagement, completion, and mastery impact. |
| Signal Analysis | Compare prediction accuracy with and without behavioral signals. |
Ambient Learning is available on Growth and above where the feature is enabled.
Use Nudge Analytics
Nudge Analytics is available inside Ambient Learning > Nudges and can also be opened directly.
Use date presets:
- 7 days.
- 30 days.
- 90 days.
Metrics include:
- Total Delivered.
- Engagement Rate.
- Completion Rate.
- Avg / Learner / Day.
- Suppression Rate.
- Breakdown by trigger type.
Trigger types include:
- Help Revisit.
- Quiz Regression.
- Module Skip.
If no nudges are delivered, Built LMS shows an empty state explaining that nudges appear after learners show signs of struggle.
Use Behavioral Signal Analysis
Open Ambient Learning > Signal Analysis or the direct Behavioral Signal Analysis page.
Use Run Analysis to compare prediction accuracy with and without behavioral signals such as time, answer changes, navigation away, and hint requests.
States:
| State | Meaning |
|---|---|
| No analysis runs yet | No run has been started. |
| Analysis in progress | Built LMS is processing behavioral signal data. |
| Analysis failed | The latest run failed and shows an error message. |
| Completed results | Built LMS shows recommendation, AUC comparison, improvement, feature importance, dataset stats, and warnings. |
Use this page when deciding whether behavioral signals improve mastery prediction enough to rely on them.
Verify success
Mastery and ambient learning views are useful when:
- Skills or competencies are mapped.
- Learner activity exists for the selected view.
- IRT data appears only after calibrated assessments or practice sessions.
- Nudge Analytics appears only after nudges are delivered.
- Behavioral Signal Analysis has a completed run before decisions rely on it.
Troubleshooting
Check that skills are mapped and learners have completed activities that produce mastery evidence.
IRT data appears only after learners complete IRT-calibrated assessments or certification practice sessions.
Nudge metrics appear only after nudges are delivered. Nudges depend on learner struggle signals such as repeated help views, quiz regression, or skipped modules.