Overview

Multirater Feedback programs get a lot of flack for being complex and unhelpful. But in reality, they are just poorly understood. We’re going to show you three ways of conducting multi rater feedback programs that go from simple to complex.

 

  • Basic
  • Standard
  • Advanced

Basic (The Simplest Multirater Cycle)

One of multirater feedback’s biggest criticisms is that is it is complex. Program creators labour under the assumption that if in order for a feedback program to be successful, it needs to be complicated.

 

But when it comes to multirater programs, simplicity is the way to go. To create a simple multirater cycle using Engagedly, log in to your account and from the Multirater icon on the left-hand menu, go to Cycles. You will be taken to the Cycle Management page.

 

Here you can see a list of all the cycles that have been created. For each cycle, there are a few actions that can be carried out. They are:

  • Edit – Clicking on this action allows you to edit the cycle
  • Copy – Clicking on this action allows you to create a copy of the cycle
  • Export Reviewer Load – Clicking on this action allows you to download an excel sheet containing the names of all the reviewers who are a part of the cycle, how many feedback requests they have received, how many they have completed and how many feedback requests they have declined.
  • Restrict visibility – Clicking on this action allows you to restrict certain users from viewing cycles which are of no relevance to them.
Multirater Cycle Management

You can also create new cycles from here. To create a new cycle, click on ‘+New Cycle’ which is located on the top right corner of the page.

 

You will be redirected to the Multirater cycle setup page where you can fill in the information about the cycle.

 

Cycle Info

 

Here you can fill in the Cycle Name and the period of review. For the simplest possible cycle, all you need to fill in is the ‘Cycle information’.

Multirater Cycle Setup

Timeline

 

In this section you can choose the people who can make reviewer nominations. It can either be the HR, the manager, or employees. But in order to make this easy, we’re going to go with the default selection which is the HR.

 

You can fill in the details like the dates from which they can nominate reviewers, date by which they should complete nominations, dates by which managers can verify and finalize the nominations etc. if you want to. Just remember to do so in an order that is chronological. Even if you make a mistake, you can always come back and edit the cycle to rectify your mistake.

 

Note:- The dates are only to help you structure your cycle. Not all dates are mandatory.

360 Degree Performance Review Multirater Timeline

Anonymity

 

Engagedly allows you to decide the anonymity of the feedback process. By default the names of the reviewers are only visible to the HR. You can also enable the options where the names of the reviewers will be visible to the reviewee and the manager.

 

Questionnaire

 

When you create a cycle, you can either use the review questionnaire present in this section or choose to use an already existing template in the template library. By default, a questionnaire is enabled during cycle creation.

 

 

To create the simplest possible multirater cycle, use the already existing questionnaire that follows the Start-Stop-Continue feedback model.

Anonymity And Questionnaire

You can also add more questions to the questionnaire by clicking on ‘+Add A Question’.

FAQ: In the questionnaire, what does @EmployeeName stand for?

Answer: The @EmployeeName is simply a placeholder for an employee’s name. When you assign a cycle with the default questionnaire, reviewers will see the questionnaire populated with the reviewee’s name.

Standard (Slightly Complex Multirater Cycle)

A slightly more complex version ( more than the basic one that is) of a multirater cycle involves the use of templates. To create a cycle with templates instead of the default questionnaire, follow all the steps that you would to create a basic multirater cycle.

 

When you come to the questionnaire, below it there is an option which says ‘Disable Cycle Questionnaire and Enable Templates’. Select this option. When you select this option, the default questionnaire is disabled and template selection has been enabled.

 

Use templates only when you want to ask different employees, different questions, be it based on their job description, their seniority level etc.

Disable Cycle Questionnaire And Enable Template

Note:- This section only allows you to enable or disable a template. You cannot select a template from this page. Template selection can be done through ‘Team Dashboard’ or ‘Org Dashboard’ after the cycle creation.

How To Create Templates?

If you choose to use a template instead of the existing questionnaire, you have to create a template first.From the Multirater icon on the left-hand menu, go to Templates. You will be taken to the Templates page. There, click on the ‘Create New’ button’.

How To Create Multirater Templates

After you click on the button, a light-box called ‘Create Template’ opens up. Give your template a name and click on Save.

Create Template

On the ‘Edit Template’ page you can begin creating your template. You can add a description of what the template is about. Then begin adding the questions you want the reviewers to answer. You can also add a description to further give context to the question.

Edit Template

For new questions, you can simply click on the Question tab or you can click on the ‘+’ button next to the Question box. To delete a question, click on the Trash icon next to the Question box. To preview your template, click on the Preview icon, which is located on the right hand side of the page.

Complex Multirater Cycle

Templates are automatically saved, so once you are done creating a template, you can click on the icon next to Edit Template and go back to the Templates page. There you will see a list of all the templates created.There are 5 actions that can be taken from this page, on your own templates and 3 actions on templates created by other users.

Co-worker Feedback Questionnaire

For templates created by you:

  • Preview
  • Assign
  • Edit
  • Copy
  • Delete

For templates created by other users:

Management Feedback Template
  • Preview
  • Assign
  • Copy

Preview

This action allows you to preview how a template looks.

 

Assign

This is one of the two ways to assign templates to users. Select a template you want to assign and click Assign. Select the cycle from the available list of cycles. You will be redirected to the Assign Template page.

 

On this page, there are two sections, Employees and Selected Employees. In the Employees section, select the employees you want to add and click Add.

Employee Assign Template

To remove employees you’ve selected by accident, go to the Selected Employees section, select the employees you want to remove and click on Remove.

Once you are done, click Assign.

Edit

By clicking on the Edit icon, you can edit a template.

Copy

To create a copy of a template, click on the Copy icon.

Management Feedback Template

Delete

To delete a template that belongs to you, click on the delete icon. Once you create a new template, you can now use it for a multirater feedback cycle.

Advanced(Complex Multirater Cycle)

This is where you should stop reading if you are not interested in knowing about complex, customized multirater cycles. We don’t generally recommend complicated multirater cycles. However, if you want to know more, then read on.

 

A complex multirater cycle is a mix of the basic and standard multirater cycles. The steps you follow for both these cycles apply. A complex multirater cycle basically involves adding a number of additional settings.

 

At the bottom of the cycle creation page is the Advanced Settings option. Click on that and a slew of additional settings will now be visible to you. They mainly consist of Nominations and Configuring Ratings and Comments.

Nominations

This section allows you to decide:

  • Maximum number of nominations
  • Ability to decline feedback requests
  • Manager or HR’s ability to modify reviewer nominations

 

The default value for max number of nominations is 6. You can either increase or decrease it. All the other nominations are enabled by default.

Nominations

Configure Ratings and Comments

 

This feature in Engagedly allows you to comment on and rate the multirater feedback given by reviewers. You can enable or disable ratings and comments for the reviewer, reviewee, manager and HR through this section. (It is not enabled by default.)

Configure Ratings And Comments

If you enable ratings, the ‘Configure Rating Scale’ section opens up. Here you can add the rating scale details like scale name and scale number. By default, a five-point rating scale is configured for a cycle.

You can add or remove the number of scales. The scale that you configure and save will be used for the current cycle.

Configure Rating Scale

Notifications

 

Engagedly gives you the ability to notify different users for different actions. You can enable or disable notifications through the ‘Notifications’ section for the following actions:

 

  • When a nominee declines a feedback request ( to the initiator)
  • When a manager changes reviewers ( to the reviewee)
  • When the HR changes reviewers ( to the reviewee)
Notification Section

Org Dashboard

The Org Dashboard is one of the most important parts of the whole Multirater Cycle.

Engagedly's Multirater dashboard

On the Organization Dashboard homepage, you can perform various actions like, changing the review cycle, adding reviewees, adding nominations etc.

LIST VIEW/HIERARCHY VIEW

While the default view in the Org Dashboard is to show all users in a list, one which is in alphabetical order, the view can also be changed to reflect the hierarchy view, where administrators can see the feedback nominations of managers and their direct reports.

Multirater Org Dashboard Hierarchy View

To change the review cycle, select the cycle you want to from the dropdown menu on the left hand top corner.

Drop Down Menu Of Multirater Cycle

ADD REVIEWEES

 

You can either add all the employees as reviewees or you can select specific employees.

Manage Reviews

Go to Add Reviewees on the top right hand corner and select All Employees to add all employees.

Engagedly's Multirater Org Dashboard

To select specific employees, click on Select Reviewees. You will be redirected to the Manage Reviewee page. From here, you can select the employees that you want to add as reviewees. Then click Add.

 

FAQ: How can I remove a reviewee?

Answer: If you’ve accidentally selected an employee as a reviewee, you can remove them by clicking on the Remove button before you save the list. However, if you want to remove a reviewee after saving the list, only a site administrator will be able to do so.

 

Note: Already selected reviewees are highlighted in yellow.

EXPORT TO EXCEL

 

You can export an excel sheet containing the organization’s multirater feedback to your system. In addition to that, you can also export an excel sheet containing the names of all the reviewers who are a part of the cycle, how many feedback requests they have received, how many they have completed and how many feedback requests they have declined.

Engagedky's Multirater feature

ADD NOMINATIONS

 

To Add Nominations, go to the Organization Dashboard page. Next to each employee’s name on the list, you will find the Peer Rating section. When you hover on the cycles there, you will see message that says Click to add nomination.

Add Nominations

To nominate reviewers for a user, click on the circles beside the username, under the Peer Rating section. A pop-up box opens up where a user can nominate reviewers. Search for the user you want to nominate and click on the employee name. After adding nominees, click Save Nomination.

Nominate Reviewer For Bill
FAQ: How do I remove a nominee for a user?

Answer: If you accidentally add a nominee, you can always remove them by double-clicking on the nominee image before saving the nomination. If you want to remove nominees after saving the nomination, hover over the nominee image beside the username and click Remove.

Remove A Nominee For A User

In the Organization Dashboard, you can view the names of the reviewees and their reviewers. You can also choose to display names by alphabetical order, by clicking on the alphabets from the alphabet list. You can go back to the original view by clicking on Reset.

 

On this page you can see the reviewee name, designation and their reporting manager if any. You can also change the status of their review. You can either Lock or Unlock a review, or Remove A Reviewee by hovering on the Status icon.

 

Note: If you want to change the review status for a number of employees at one go, when you select an action, you will also see a Select All check box. When you check this box, all users will be selected.

In the same way, you can see the status of Employee, Manager and HR Reviews. You can either Recall a review, or Notify an employee/manager for pending reviews by hovering over the review icons.

Engagedly's Multirater Org Dashboard

The Legend button explains the different status that are present in the Peer Rating section.

Peer Rating Section Status On Legend Button

Assigning A Template Through Organization Dashboard

When you select a cycle where you want to use a feedback template, an extra column called Template is displayed on the Organization Dashboard. Click on Assign beside the reviewee name in the template column.

Multirater Dashboard Assign

A list of available templates is displayed from which you can select the one you feel is the most appropriate, preview it if you would like to and select the template and click on Done.

MultiraterTemplate

To un-assign a template, click on the Un-assign button in the Template column. Checkmark the reviewee names that you want to un-assign the template from and click on ‘Remove’.

Team Dashboard

The Team Dashboard allows the managers and HR to monitor the Multirater review process of their direct reports.

Peer Rating Section Status On Legend Button

Managers can also remove reviewers from here, though they can also do this for their direct reports. They can also view the responses for their direct reports by clicking on the number of reviewers for each user, if that option has been enabled in the settings.

Reviewee Perspective

My Dashboard

On the My Dashboard page, there are three sections.

 

  • Feedback about me
  • Archived Reviews
  • Feedback I need to give
Engagedly's Multirater Dashboard

Feedback about me – In this section you will see the list of multirater feedback received by you. Click on any cycle and a lightbox opens up. If the HR has not enabled anonymity, you can see the feedback you have received.

You can also download your reviews by clicking on the Export As PDF button. A PDF version of the review will then be downloaded to your system.

Engagedly's Multirater feature

If the HR has enabled feedback anonymity and also included overall self-ratings, you will be able to give yourself feedback, but you will not be able to see the feedback other users have given.

 

In some cases, the HR can also change the visibility settings once a cycle is completed, so you will then be able to see all the feedback you have received.

Engagedly's Multirater feature

Archived Reviews – Once a multirater cycle is over and the HR locks all the reviews in the cycle, the cycle will show up in the ‘Archived Reviews’ section.

Feedback I need to give – In the ‘Feedback I Need To Give Section’ you can find all the requests you receive for feedback. If you do not want to give the feedback you can simply click on ‘Decline Request’ beside the cycle name.

 

To review, you can click on the name of the cycle from the list of requests and fill in the review template. After that you can either save it for modifications in future by clicking ‘Save’ and share it later or share it right away by clicking on ‘Share’.

 

When you fill in the review template and save it without sharing, the status of the review request changes to ‘In Progress’. Once you complete reviewing, the status of that request changes to ‘Completed’.

 

You can view the feedback you gave just by clicking on the cycle name from the list. Your review cannot be modified unless the administrator unlocks your review from the ‘Org Dashboard’.

Engagedly's Multirater Dashboard

Updated for Engagedly Release No: 2.3.0, dated September 19  2016.