Activity Group Scoring

What is Activity Group Scoring?

Activity Group Scoring is a new type of lab passing policy designed to provide a more structured method for assessing and scoring labs. Activity Groups often represent Tasks (as might appear on a job description, Job Task Analysis, or skill framework) or Learning Objectives (as might appear in curriculum design.) Activity Group Scoring allows a lab builder to set a passing policy at both the activity group and lab level, giving organizations more granular data about which tasks or learning objectives that a learner has mastered.

Here's an example of two labs with the same structure, one which uses the traditional Activity Scoring policy, one which uses Activity Group Scoring.

Intended Use

For organizations who leverage tasks, learning objectives, or other organizing principles that are larger than individual activities but smaller than labs, this feature allows a builder to score a lab based on a learner's performance within those tasks or learning objectives.

Purpose

The purpose of Activity Group Scoring is to provide a way to assess and score multiple activities as a single unit, making it easier to assess a learner's mastery.
Scenarios:

• Skill validation: Skillable's Skill Validation content standards recommend a task-based definition of a skill. To prove they have a skill, users must complete a specified list of tasks. Those tasks are represented by Activity Groups.

• Scenerio-based labs: Labs representing business scenerios require more structured approaches to grouping and assessing activities. With activity group scoring, a user will see their performance in the language they understand, the language of business.

Key Elements

Components:

1. Scoring Mode Selection:

   • Functionality: Choose between scoring individual activities or scoring activities as a group.
   • Options: "Select From List", "Activity Scoring", "Activity Group Scoring".

   

2. Scoring Results Display Type Selection:

   • Functionality: Decide how scoring results are shown based on the selected scoring mode.
   • Options: Different options depending on the scoring mode.

   

3. Confirmation Dialog:

   • Functionality: Confirm changes when switching scoring modes.
   • Elements: Title, message, Cancel button, OK button.

   

4. Management Dialog:

   • Functionality: Manage properties of activity groups, including enabling scoring and setting passing scores.
   • Elements: Scoring checkbox, passing score input, score value input.

   

5. Alerts and Notices:

   • Functionality: Display alerts and notices related to scoring, such as warnings for unscored activities.

   

User Information

When should I use Activity Group Scoring?

• When you want to assess a user's ability to perform several tasks or learning objectives within a single lab.
• When you want to build a skill validation lab.
• When you are building a lab based on a business scenerio, a job description, or a Job Task Analysis.

Why would I use Activity Group Scoring instead of Activity Scoring?

• When what you need to measure or assess comprises multiple steps or activities.
• When you want to represent tasks or learning objectives.
• When you want to represent a user's lab performance based on specific tasks or learning objectives.

How do I use Activity Group Scoring?

Selecting Scoring Mode

1. Navigate to Studio > Lab profile > Activities.

2. Locate the Scoring Mode dropdown menu.

3. Select Activity Group Scoring.

   Safeguard

   Activity Scoring is the default scoring mode. A confirmation dialog will appear to ensure you want to switch modes.

2. Managing Activity Groups

1. To create a new activity group, click New Group.

2. Fill in group name and replacement token alias.

3. Enable scoring for the group by checking the "Scored" checkbox.

   • Enter the points required to pass the activity group.
   • Enter the points awarded for passing the activity group.
   Scoring Options

   Once scoring is enabled you will be able to specify the two scoring options:

   How many points are required to pass?
   This is the total number of points a user must earn from all activities in the group in order to pass the activity group.

   How many points should be awarded for passing?

This is the number of points a user will earn if they pass the activity group (e.g., meet the threshold listed above.
:::

• Safeguard: The system will validate the inputs to ensure they meet the required criteria (e.g., passing points cannot be less than 1 or greater than 999).

3. Configuring End of Lab Scoring Results Display Format

1. After setting up the scoring mode and groups, navigate to the Scoring Results Display Type dropdown.

   

2. Select how you want the scoring results to be displayed after the lab is completed and scored.

3. Choose grouped scoring results

   Safeguard

   Alerts and notices will be displayed if there are any issues with the scoring setup, such as unscored activities within a group.

4. Transitioning Between Scoring Modes

1. When switching from "Activity Scoring" to "Activity Group Scoring" or vice versa, select the desired mode from the Scoring Mode dropdown.

2. A confirmation dialog will appear, explaining the changes and asking for confirmation.

3. Confirm the change to proceed.

   Safeguard

   The system will display warnings and require confirmation to prevent accidental changes.

   Additional Safeguard

   Additionally, any ungrouped activities will be automatically placed into a new activity group called New Group to ensure no activities are left unscored.

Handling Ungrouped Activities When Switching Scoring Modes

How to ensure all activities are outlined and provide reporting and help when switching scoring modes with ungrouped activities?

Scenario:

When switching from "Activity Scoring" to "Activity Group Scoring" or vice versa, there might be ungrouped activities that need to be addressed. Any ungrouped activity is automatically added to a default group called New Group. This section outlines the steps to ensure all activities are properly grouped and provides reporting and help for the lab author.

Steps to Resolve:

1. Identify Ungrouped Activities

• Navigate to the activities tab.

• Check the group named New Group.

• This is the default group that captures any ungrouped activities when switching scoring modes from Activity Scoring to Activity Group Scoring.

  If you did not group your activities before switching to Activity Group Scoring

  Here is an example of what the user will see once switching scoring modes to Activity Group Scoring and there were three questions that were ungrouped. Notice that these are automatically joined into a single default group called New Group.

  

2. Create Appropriate Groups

• If ungrouped activities are found, verify that a group exists that will be used to group the activity to. if there is not an appropriate Activity Group, create a new activity group.

3. Move Activities to appropriate Group

• Move the specific activity from the default New Group into the newly created group.

  How Do I move Activities to Another Group?

  Moving an activity to a new group is simply accomplished by selecting the Move button on the specific activity. Once selected there will be a Move Activity modal that pops up that allows the user to specify the New Group.

  TIP: Just start typing in the New Group text field and any matching Group will be presented in a dropdown to allow an item to be selected.

  

4. Validate Grouping

• Ensure that all activities are now part of the appropriate group.

• Verify that no activities are left ungrouped.

• Make sure that scoring options are set on the Activity Group level.

  

5. Provide Reporting and Help

• Alerts and notices related to the grouping and scoring setup are displayed to assist in resolving the discrepancies.

  How Do I Use the Alerts to Assist Me in Resolving Issues?

  Typical Scenario: A New Group was created and activities were moved into this group or new activities created in the group. The Lab Author decides to score one of the activities and did not setup any scoring at the Activity Group Level. The user needs to decides that "Yes I want the current activity Group scored but I have a warning. How do I get help?"

  

  Notice: The Warning chip at the Activity Group header indicating that this group has scored activities and that the Group is not set for scoring. This is noticed because in the header of the Activity Group there are no Scoring Options visible.

  What should the User do Now?
  Select the Edit button on the Activity Group level to add the missing scoring options.

  

  1. Read the warning message to see that the current edited group has scored activities but there is no scoring setup at the Activity Group level.
  2. Select Scored checkbox to reveal the Scoring parameters.

  

  Notice: The warning message is no longer displayed since the Scoring Options were filled in. Make sure the Appropriate values are set in the Scoring parameters and select OK to save the changes.

  Once saved you will be taken back to the Activities window and the warning on the Activity Group is no longer there as the appropriate scoring steps have been taken to resolve the missing configuration.

  

  Notice: You will now see that the scoring parameters are now visible in the Activity Group header and also the single activity shows the score that it is out of.

6. Tools Needed

• Scoring Mode selection: To switch between scoring modes.
• Management Dialog: To create and manage activity groups.
• Alerts and Notices: To inform the lab author of any issues with the scoring setup.

By following these steps, you can ensure that all activities are properly outlined and provide the necessary reporting and help when switching scoring modes with ungrouped activities.

Scoring Results

Overview:

The scoring results section provides detailed information on how the scores are calculated and displayed based on the selected scoring mode.

Components:

Scoring Results Display Type Selection

• Functionality: Decide how scoring results are shown based on the selected scoring mode.
• Options: Different options depending on the scoring mode.

Viewing Scoring Results

1. After setting up the scoring mode and groups, navigate to the Scoring Results Display Type dropdown.
2. Select how you want the scoring results to be displayed.
3. Launch the Lab and submit for scoring to View the results in the specified format.

End of Lab Activity Group Scoring Results Page

The End of Lab Activity Group Scoring Results page provides a comprehensive summary of the scores for each activity group. This page includes the following elements:

• Objective-Based Assessment: Each activity group represents a specific topic or skill that the user must demonstrate proficiency in.
• Holistic Scoring: Users receive scores for each topic, which contribute to an overall lab score.
• Enhanced Reporting: The end-of-lab reports reflect topic-based scores, detailing both the overarching topic scores and the individual activity scores within those groups.
• Skills Tagged to Topics: Skills tagged to topics are visible, offering comprehensive insight into performance (Note: Only visible if Skills are configured for your Organization).
• Detailed Results Button: Allows users to switch the report back to the classic style report.
• Activity Names and Skills: Text in purple defines the skills that the activity group checks against, and text in the grey box defines the activity name for that skill.