brainsteam.co.uk/brainsteam/content/annotations/2022/11/23/1669233702.md

date	hypothesis-meta	in-reply-to	tags	type	url
2022-11-23T20:01:42	created document flagged group hidden id links permissions tags target text updated uri user user_info 2022-11-23T20:01:42.722732+00:00 title 2210.07188.pdf false __world__ false pn7SimtpEe2Rlr_TC_SBhg html incontext json https://hypothes.is/a/pn7SimtpEe2Rlr_TC_SBhg https://hyp.is/pn7SimtpEe2Rlr_TC_SBhg/arxiv.org/pdf/2210.07188.pdf https://hypothes.is/api/annotations/pn7SimtpEe2Rlr_TC_SBhg admin delete read update acct:ravenscroftj@hypothes.is acct:ravenscroftj@hypothes.is group:__world__ acct:ravenscroftj@hypothes.is coreference data-annotation NLProc selector source end start type 20125 19879 TextPositionSelector exact prefix suffix type Procedure: We first launch an annotation tutorial(paid $4.50) and recruit the annotators on the AMTplatform.9 At the end of the tutorial, each annotatoris asked to annotate a short passage (around 150words). Only annotators with a B3 score (Bagga asure inter-annotator agreement. 8The PreCo dataset is interestin TextQuoteSelector https://arxiv.org/pdf/2210.07188.pdf Annotators are asked to complete a quality control exercise and only annotators who achieve a B3 score of 0.9 or higher are invited to do more annotation 2022-11-23T20:01:42.722732+00:00 https://arxiv.org/pdf/2210.07188.pdf acct:ravenscroftj@hypothes.is display_name James Ravenscroft	https://arxiv.org/pdf/2210.07188.pdf	coreference data-annotation NLProc hypothesis	annotation	/annotation/2022/11/23/1669233702

Procedure: We first launch an annotation tutorial(paid $4.50) and recruit the annotators on the AMTplatform.9 At the end of the tutorial, each annotatoris asked to annotate a short passage (around 150words). Only annotators with a B3 score (Bagga

Annotators are asked to complete a quality control exercise and only annotators who achieve a B3 score of 0.9 or higher are invited to do more annotation