The Impact of Real-Time Feedback in Employee Reviews

New Research Shows Relationships, Favoritism and Gender All Play a Role

INFORMS Journal Information Systems Research Study Key Takeaways:

• In real-time feedback the relationship source (peer, subordinate or supervisor) plays a role: the feedback tends to be more critical when it is from supervisors.
• Favoritism and retribution are impacted in real-time feedback: Supervisors adopt tit-for-tat strategies, but peers do not.
• Men rate women higher than men, and women rate men and women similar to how men rate men.
• Positive real-time feedback has a stronger effect on future ratings than negative feedback.

CATONSVILLE, MD, May 20, 2021 – To deliver real-time feedback to support employee development and rapid innovation, many companies are replacing formal, review-based performance management with systems that enable frequent and continuous employee evaluation. New research in the INFORMS journal Information Systems Research examines the role of these applications to understand the effects on employee performance appraisals.

The study, “Are Traditional Performance Reviews Outdated? An Empirical Analysis on Continuous, Real-time Feedback in the Workplace,” was conducted by Michael Rivera and Subodha Kumar from Temple University and Liangfei Qiu from the University of Florida. The authors found that the relationship source (peer, subordinate or supervisor) impacts real-time feedback, which tends to be more critical when it comes from supervisors.

“What is more interesting is the effect of favoritism and retribution in real-time feedback: Supervisors adopt tit-for-tat strategies, but peers do not,” said Kumar, a professor in the Fox School of Business at Temple. “We also uncover that men rate women higher than men, and that women rate men and women similar to how men rate men.”

In addition, positive real-time feedback has a stronger effect on future ratings than negative feedback.

Real-time feedback applications enable supervisors and employees to give, seek and receive competency-based feedback using their computers, smartphones or other devices.

The authors used data from five different organizations using the platform DevelapMe. The organizations spanned several industries including pharmaceutical, healthcare, interior design and payment processing. The data consisted of around 5,000 instances of feedback.

“Our findings have direct implications for the design and implementation of performance management systems,” said Kumar. “We highlight how companies can use information systems to create an innovative human resource operation that delivers flexibility and agility.” 

Link to full study.

About INFORMS and Information Systems Research 

Information Systems Research is a premier peer-reviewed scholarly journal that covers the latest theory, research and intellectual developments for information systems in institutions, organizations, the economy and society to advance knowledge about the effective and efficient utilization of information technology. It is published by INFORMS, the leading international association for operations research and analytics professionals. More information is available at www.informs.org or @informs.

###

Contact:

Ashley Smith

443-757-3578

[email protected]