Built LMS Help Center
Data & Analytics

Review Mastery and Ambient Learning

Review skill mastery, IRT analytics, ambient learning activity, nudges, and behavioral signal analysis.

Use this guide when you need to understand learner mastery signals or activity captured outside normal course completion.

Before you begin

You need analytics access and enough learner activity for meaningful signals.

Before reviewing mastery or ambient learning, confirm:

  • Skills or competencies are mapped where mastery analysis is expected.
  • Learners have completed activities that produce mastery evidence.
  • Ambient learning and nudges are enabled for the organization where required.
  • Privacy mode allows the level of user detail you expect to see.

Review learner mastery

Use Learner Mastery

Open Intelligence > Learners > Mastery to review skill mastery across the organization or team.

Tabs:

TabUse
OverviewSkill mastery summary and gaps.
DiagnosticsConfidence-adjusted mastery and IRT analytics.

Learner questions to the learning assistant are under Intelligence > Courses > Learner Questions.

The active tab is reflected in the URL with a tab parameter, so browser back and forward can preserve the selected tab.

Use IRT Analytics

Open Intelligence > IRT Analytics directly or use the Diagnostics tab inside Learner Mastery.

IRT Analytics includes:

  • Learners with IRT data.
  • Practice sessions.
  • Courses with practice.
  • Learner table.
  • Raw Mastery.
  • Adjusted Mastery.
  • Guess Rate.
  • Skills.
  • Responses.
  • Expandable per-skill breakdown.
  • Certification practice analytics.

High guess-rate skills are flagged. Use those flags to distinguish fragile mastery from stronger evidence of understanding.

If no IRT assessment data appears, learners have not completed IRT-calibrated assessments or certification practice sessions yet.

Review ambient learning

Use Ambient Learning

Open Intelligence > Ambient learning for bot interactions, TIL insights, nudges, and behavioral signal analysis.

Tabs:

TabUse
ActivityBot activity and event types.
TIL Insights"Today I Learned" insight feed.
NudgesNudge delivery, engagement, completion, and mastery impact.
Signal AnalysisCompare prediction accuracy with and without behavioral signals.

Ambient Learning is available on Growth and above where the feature is enabled.

Use Nudge Analytics

Nudge Analytics is available inside Ambient Learning > Nudges and can also be opened directly.

Use date presets:

  • 7 days.
  • 30 days.
  • 90 days.

Metrics include:

  • Total Delivered.
  • Engagement Rate.
  • Completion Rate.
  • Avg / Learner / Day.
  • Suppression Rate.
  • Breakdown by trigger type.

Trigger types include:

  • Help Revisit.
  • Quiz Regression.
  • Module Skip.

If no nudges are delivered, Built LMS shows an empty state explaining that nudges appear after learners show signs of struggle.

Use Behavioral Signal Analysis

Open Ambient Learning > Signal Analysis or the direct Behavioral Signal Analysis page.

Use Run Analysis to compare prediction accuracy with and without behavioral signals such as time, answer changes, navigation away, and hint requests.

States:

StateMeaning
No analysis runs yetNo run has been started.
Analysis in progressBuilt LMS is processing behavioral signal data.
Analysis failedThe latest run failed and shows an error message.
Completed resultsBuilt LMS shows recommendation, AUC comparison, improvement, feature importance, dataset stats, and warnings.

Use this page when deciding whether behavioral signals improve mastery prediction enough to rely on them.

Verify success

Mastery and ambient learning views are useful when:

  • Skills or competencies are mapped.
  • Learner activity exists for the selected view.
  • IRT data appears only after calibrated assessments or practice sessions.
  • Nudge Analytics appears only after nudges are delivered.
  • Behavioral Signal Analysis has a completed run before decisions rely on it.

Troubleshooting

On this page