The Engagement Report - Detailed Information

The Engagement Report - Detailed Information

Info
This article is intended for instructors.

Purpose of this article

This article explains the engagement metrics that can be included in the report and how each metric is calculated. These metrics are optional and can be selected or removed based on your grading approach.

Metrics Used to Calculate Engagement

Idea
Metric
What it measures
Why it matters
Time Spent on Site (Minutes)
Total active time spent by a participant in the Simulation phase (excluding Practice Zone and Tutorials)
Reflects effort and sustained engagement
Saved Decisions
The number of decisions saved by a company
Reflects active participation in decision-making
Reports Consulted
The number of end-of-year Reports read by a participant (e.g. Income Statement)
Indicates review and interpretation of performance
Indicators Consulted
The number of indicators (metrics) reviewed by a participant
Supports understanding of cause and effect
Podiums Consulted
The number of podiums (competitive rankings) reviewed by a participant
Reinforces benchmarking and strategic awareness

Important Notes

  1. Interaction with Neo (Praxar's AI chatbot) does not contribute to Time Spent on Site
  2. All metrics (except Time Spent on Site) are based on the number of actions completed. Example: 10 out of 12 decisions saved = 83%
  3. Saved Decisions reflect group activity, not individual student tracking when working in teams

Converting Time Spent on Site

Time Spent on Site is evaluated relative to other participants in the same simulation group and Year (round). This ensures that engagement is assessed fairly across all participants.

This approach helps to:

  • Reduce subjectivity in scoring
  • Increase fairness and consistency
  • Account for unusually high or low activity levels

Detailed Calculation Method

Step 1: Identify quartiles (Q1 and Q3)
  • Q1 (first quartile): value below which 25% of participants fall
  • Q3 (third quartile): value above which 25% of participants fall

Step 2: Calculate the interquartile range (IQR)
  • IQR = Q3 − Q1

Step 3: Determine the upper limit
  • Upper limit = Q3 + (1.5 × IQR)
  • This identifies unusually high values (outliers)

Score Assignment

Based on where a participant’s time falls:

  • Above upper limit: 100%
  • Between Q3 and upper limit: 85%–100%
  • Between Q1 and Q3: 75%–85%
  • At or below Q1: 0%–75%

Weighting of Engagement Metrics - Final Score

Each metric contributes to the final Engagement Score based on its assigned weight. These weights can be adjusted depending on your grading criteria.

Example:

  • Time Spent on Site: 40%
  • Saved Decisions: 30%
  • Reports Consulted: 20%
  • Indicators Consulted: 5%
  • Advice Read: 3%
  • Podiums Consulted: 2%
AlertMetrics can also be removed entirely if they are not relevant to your course/pedagogy.

Final Engagement Score

The final Engagement Score is calculated by combining the selected metrics according to their assigned weights.

Click here to learn how to use Praxar's Engagement report.



Idea
Have questions? Contact us at service@praxar.com
    • Related Articles

    • How to use the Engagement report

      This article is intended for instructors. This is for Entrepreneurship, Management and marketing simulations. It is possible to create a custom engagement report for a simulation. This report provides a detailed view of participant interaction in ...
    • Instructor Zone - Step-by-step Guide

      This article is intended for instructors. When accessing your new portal 2.0, the INSTRUCTOR ZONE contains all the tools you need to manage your group simulation. The objective of this article is to clarify: When to use a specific tool? Why use a ...
    • How to use the Auto-Grading report

      This article is intended for instructors. See instructional video below. This grading report is customizable and provides automation in evaluating your students. You can select from a list of metrics/KPIs/evaluation tools to build your report and ...
    • The Grading Report: How grades are calculated

      This article is intended for instructors. To use Praxar's Grading report, see this article here. Calculating Grades To calculate grades, the platform (auto-grading tool) follows four steps: Step 1 - Converting Min/Max Fields to Percentage For Min/Max ...
    • Financial accounting: How do I select the required fields for my reports?

      This article is intended for instructors. This article concerns only the three components of the Financial Accounting simulation: Financial Statements, Financial Analysis and Budgeting. Regardless of which component(s) you're working on, the ...