brainsteam.co.uk/brainsteam/content/annotations/2022/11/23/1669234701.md

date	hypothesis-meta	in-reply-to	tags	type	url
2022-11-23T20:18:21	created document flagged group hidden id links permissions tags target text updated uri user user_info 2022-11-23T20:18:21.503899+00:00 title 2210.07188.pdf false __world__ false -dKc5GtrEe2QDyN0zg00rw html incontext json https://hypothes.is/a/-dKc5GtrEe2QDyN0zg00rw https://hyp.is/-dKc5GtrEe2QDyN0zg00rw/arxiv.org/pdf/2210.07188.pdf https://hypothes.is/api/annotations/-dKc5GtrEe2QDyN0zg00rw admin delete read update acct:ravenscroftj@hypothes.is acct:ravenscroftj@hypothes.is group:__world__ acct:ravenscroftj@hypothes.is data-annotation coreference NLProc selector source end start type 28783 28631 TextPositionSelector exact prefix suffix type Our annotators achieve thehighest precision with OntoNotes, suggesting thatmost of the entities identified by crowdworkers arecorrect for this dataset. ntoNotes, GUM, Lit-Bank, ARRAU: In terms of F1 scores, thedatase TextQuoteSelector https://arxiv.org/pdf/2210.07188.pdf interesting that the mention detection algorithm gives poor precision on OntoNotes and the annotators get high precision. Does this imply that there are a lot of invalid mentions in this data and the guidelines for ontonotes are correct to ignore generic pronouns without pronominals? 2022-11-23T20:18:21.503899+00:00 https://arxiv.org/pdf/2210.07188.pdf acct:ravenscroftj@hypothes.is display_name James Ravenscroft	https://arxiv.org/pdf/2210.07188.pdf	data-annotation coreference NLProc hypothesis	annotation	/annotation/2022/11/23/1669234701

Our annotators achieve thehighest precision with OntoNotes, suggesting thatmost of the entities identified by crowdworkers arecorrect for this dataset.

interesting that the mention detection algorithm gives poor precision on OntoNotes and the annotators get high precision. Does this imply that there are a lot of invalid mentions in this data and the guidelines for ontonotes are correct to ignore generic pronouns without pronominals?