The Engagement Report - Detailed Information

The Engagement Report - Detailed Information

Info
This article is intended for instructors.

Purpose of this article

This article explains the engagement metrics that can be included in the report and how each metric is calculated. These metrics are optional and can be selected or removed based on your grading approach.

Metrics Used to Calculate Engagement

Idea
Metric
What it measures
Why it matters
Time Spent on Site (Minutes)
Total active time spent by a participant in the Simulation phase (excluding Practice Zone and Tutorials)
Reflects effort and sustained engagement
Saved Decisions
The number of decisions saved by a company
Reflects active participation in decision-making
Reports Consulted
The number of end-of-year Reports read by a participant (e.g. Income Statement)
Indicates review and interpretation of performance
Indicators Consulted
The number of indicators (metrics) reviewed by a participant
Supports understanding of cause and effect
Podiums Consulted
The number of podiums (competitive rankings) reviewed by a participant
Reinforces benchmarking and strategic awareness

Important Notes

  1. Interaction with Neo (Praxar's AI chatbot) does not contribute to Time Spent on Site
  2. All metrics (except Time Spent on Site) are based on the number of actions completed. Example: 10 out of 12 decisions saved = 83%
  3. Saved Decisions reflect group activity, not individual student tracking when working in teams

Converting Time Spent on Site

Time Spent on Site is evaluated relative to other participants in the same simulation group and Year (round). This ensures that engagement is assessed fairly across all participants.

This approach helps to:

  • Reduce subjectivity in scoring
  • Increase fairness and consistency
  • Account for unusually high or low activity levels

Detailed Calculation Method

Step 1: Identify quartiles (Q1 and Q3)
  • Q1 (first quartile): value below which 25% of participants fall
  • Q3 (third quartile): value above which 25% of participants fall

Step 2: Calculate the interquartile range (IQR)
  • IQR = Q3 − Q1

Step 3: Determine the upper limit
  • Upper limit = Q3 + (1.5 × IQR)
  • This identifies unusually high values (outliers)

Score Assignment

Based on where a participant’s time falls:

  • Above upper limit: 100%
  • Between Q3 and upper limit: 85%–100%
  • Between Q1 and Q3: 75%–85%
  • At or below Q1: 0%–75%

Weighting of Engagement Metrics - Final Score

Each metric contributes to the final Engagement Score based on its assigned weight. These weights can be adjusted depending on your grading criteria.

Example:

  • Time Spent on Site: 40%
  • Saved Decisions: 30%
  • Reports Consulted: 20%
  • Indicators Consulted: 5%
  • Advice Read: 3%
  • Podiums Consulted: 2%
AlertMetrics can also be removed entirely if they are not relevant to your course/pedagogy.

Final Engagement Score

The final Engagement Score is calculated by combining the selected metrics according to their assigned weights.

Click here to learn how to use Praxar's Engagement report.



Idea
Have questions? Contact us at service@praxar.com