RGIR Presentation

Written on 09/16/2013. Filed under Events.

The Effects of Threshold Priming and Need for Cognition on Relevance Assessments:

Human assessments of document relevance are needed for the construction of test collections, ad-hoc evaluation, and training text classifiers. However, showing documents to assessors in different orderings may lead to different assessments of the same documents and consequently different assessment outcomes. In this research, we examine the effects of priming on people’s perception and thresholding of relevance, and how need for cognition impacts relevance assessments.