Are you a racist or am i seeing things? annotator influence on hate speech detection on twitter

Abstract

1Data set available at http://github.com/zeerakw/hatespeech 138 Page 2. 2 Data Waseem and Hovy (2016) may suffer from personal bias, as the only the authors an- notated, and only the annotations positive for hate speech were reviewed by one other person