brainsteam.co.uk/brainsteam/content/annotations/2022/11/23/1669234701.md

2.2 KiB

date hypothesis-meta in-reply-to tags type url
2022-11-23T20:18:21
created document flagged group hidden id links permissions tags target text updated uri user user_info
2022-11-23T20:18:21.503899+00:00
title
2210.07188.pdf
false __world__ false -dKc5GtrEe2QDyN0zg00rw
html incontext json
https://hypothes.is/a/-dKc5GtrEe2QDyN0zg00rw https://hyp.is/-dKc5GtrEe2QDyN0zg00rw/arxiv.org/pdf/2210.07188.pdf https://hypothes.is/api/annotations/-dKc5GtrEe2QDyN0zg00rw
admin delete read update
acct:ravenscroftj@hypothes.is
acct:ravenscroftj@hypothes.is
group:__world__
acct:ravenscroftj@hypothes.is
data-annotation
coreference
NLProc
selector source
end start type
28783 28631 TextPositionSelector
exact prefix suffix type
Our annotators achieve thehighest precision with OntoNotes, suggesting thatmost of the entities identified by crowdworkers arecorrect for this dataset. ntoNotes, GUM, Lit-Bank, ARRAU: In terms of F1 scores, thedatase TextQuoteSelector
https://arxiv.org/pdf/2210.07188.pdf
interesting that the mention detection algorithm gives poor precision on OntoNotes and the annotators get high precision. Does this imply that there are a lot of invalid mentions in this data and the guidelines for ontonotes are correct to ignore generic pronouns without pronominals? 2022-11-23T20:18:21.503899+00:00 https://arxiv.org/pdf/2210.07188.pdf acct:ravenscroftj@hypothes.is
display_name
James Ravenscroft
https://arxiv.org/pdf/2210.07188.pdf
data-annotation
coreference
NLProc
hypothesis
annotation /annotation/2022/11/23/1669234701
Our annotators achieve thehighest precision with OntoNotes, suggesting thatmost of the entities identified by crowdworkers arecorrect for this dataset.
interesting that the mention detection algorithm gives poor precision on OntoNotes and the annotators get high precision. Does this imply that there are a lot of invalid mentions in this data and the guidelines for ontonotes are correct to ignore generic pronouns without pronominals?