Evaluator's guide to the Stars rating evaluation mode

A step-by-step guide for evaluators who were given the task of evaluating the submitted sessions by using the Stars Rating evaluation mode

In this step-by-step guide, we're taking you through the entire process of using the Stars rating evaluation mode. You'll learn how to access the evaluation plan, go through the evaluation process, track your progress, and review the work you've done.

Are you an event organizer? To find out about the differences between the three evaluation modes offered by Sessionize, please refer to the following article: Evaluation modes explained. If you're an event organizer and want to learn how to set up your first evaluation, please click here: Evaluations: Getting started.

 

Access the evaluation plan

Look for your evaluation plan on the Evaluation page when using Sessionize in Organizer mode

After you log into Sessionize, check the top left corner of the page and make sure you're in Organizer mode. Then select the event you're looking for and access the Evaluation page. There you'll find a list of active evaluations assigned to you. Every event can have single or multiple evaluations running at the same time, depending on how the organizer has set the evaluation process up. Finally, look for the evaluation plan you want to start working on and click Evaluate.

When accessing the event in Organizer mode, the number of pages available to you depends on your team role. If your role is Evaluator, you won't be able to access anything other than the aforementioned Evaluation page. Team members with other roles will have access to various other event pages.

 

Check the instructions and deadline

Read the organizer's instructions to find out if there's anything specific expected from you

Before you start evaluating the sessions, it is a good idea to check the top of the page, where you'll find the organizer's instructions. Different event organizers can have different expectations from their evaluators, so by checking the instructions, you can be certain that you're in perfect alignment with the organizer.

Check the evaluation deadline on the Evaluation page

Don't forget to check the evaluation deadline too. The deadline is visible when viewing the Evaluation page. Look for it next to the evaluation plan.

If you don't see any specific instructions or deadlines, that means the organizer didn't enter any. You're free to proceed with the evaluation.

 

Start evaluating

The progress bar updates in real-time, letting you know how far in the evaluation process you've come

The Stars rating evaluation mode is very easy to understand. All you have to do is examine the session information and rate it with 1-5 stars. Half-star ratings (0.5, 1.5, 2.5, 3.5, 4.5) are also possible. Once you're done, click on the Save and continue button to confirm your rating and move on to the next session.

Some event organizers opt to use the multiple criteria option for the Stars rating evaluation plan. The only difference for you as an evaluator is that you have to rate a session through a number of criteria instead of just giving it a singular overall rating. Everything else remains the same, meaning that once you're happy with your ratings, click on Save and continue to move on.

Don't see the speaker's name, photo, biography, and other information? The event organizer activated the Anonymous Mode for you. With the Anonymous Mode active, real speaker names are replaced with made-up ones, and speaker photos, biographies, taglines, and all other speaker fields are hidden from the evaluator.

 

If you have a hard time coming up with a decision about a certain session, you have the option to skip it and come back to it later. Simply click on the arrow flanking the Save and continue button to expand the appropriate menu and select the Skip and ask later option. This can be particularly useful if you have only just started with the evaluation process and would like to get a better sense of the overall quality of the submitted sessions.

In case a certain session covers a subject you're completely unfamiliar with, so there's no way for you to competently evaluate it, click on the Ignore this session button. Our evaluation system won't ask you about that session anymore.

Track your progress

As you plow through the evaluation process, you'll see a progress bar at the top of the page, indicating how far along you've come. If at any time you have to stop evaluating the sessions temporarily, click on the Stop and continue later button found above the progress bar. When you return, you'll be able to pick up where you left off.

Keep track of your past evaluations and reevaluate the ones you aren't happy with

On the right is a box with several useful tabs. The default tab is Recent. You can use it to keep track of your past session evaluations, but it has an additional purpose: you can click on any of the sessions to reopen them and potentially change your evaluation.

Here's a complete overview of the tabs found in the aforementioned box:

  • Recent - a list of sessions you recently evaluated
  • Speaker - see other sessions submitted by the same speaker (assuming they exist)
  • Similar - browse similar sessions
  • Search - look through all nominated sessions

Complete the evaluation and view your stats

Change your evaluation even after you've completed the initial process

Once you're done with the evaluation, you'll automatically be redirected to the Evaluation page. By opening the evaluation plan you've just completed, you can view your statistics, as well as potentially change your mind on any of the sessions by clicking on the corresponding edit button.

Related articles

Evaluation modes explained

An overview of three different ways to evaluate the sessions submitted for your event

  • November 6th, 2023
  • 3935 views
  • 14 likes

Evaluations: From start to finish

A step-by-step guide on setting up an evaluation process for the sessions submitted for your event

  • February 13th, 2023
  • 2502 views
  • 13 likes