---
date: '2022-11-23T19:56:25'
hypothesis-meta:
  created: '2022-11-23T19:56:25.933796+00:00'
  document:
    title:
    - 2210.07188.pdf
  flagged: false
  group: __world__
  hidden: false
  id: 6ayOcmtoEe2a2efc7jjUHQ
  links:
    html: https://hypothes.is/a/6ayOcmtoEe2a2efc7jjUHQ
    incontext: https://hyp.is/6ayOcmtoEe2a2efc7jjUHQ/arxiv.org/pdf/2210.07188.pdf
    json: https://hypothes.is/api/annotations/6ayOcmtoEe2a2efc7jjUHQ
  permissions:
    admin:
    - acct:ravenscroftj@hypothes.is
    delete:
    - acct:ravenscroftj@hypothes.is
    read:
    - group:__world__
    update:
    - acct:ravenscroftj@hypothes.is
  tags:
  - coreference
  - data-annotation
  - NLProc
  target:
  - selector:
    - end: 13153
      start: 12521
      type: TextPositionSelector
    - exact: "Annotation structure: Two annotation ap-proaches are prominent in the\
        \ literature: (1) a localpairwise approach, annotators are shown a pairof\
        \ mentions and asked whether they refer to thesame entity (Hladk\xE1 et al.,\
        \ 2009; Chamberlain et al.,2016a; Li et al., 2020; Ravenscroft et al., 2021),which\
        \ is time-consuming; or (2) a cluster-basedapproach (Reiter, 2018; Oberle,\
        \ 2018; Bornsteinet al., 2020), in which annotators group all men-tions of\
        \ the same entity into a single cluster. InezCoref we use the latter approach,\
        \ which can befaster but requires the UI to support more complexactions for\
        \ creating and editing cluster structures."
      prefix: n detection and AMT Integration.
      suffix: 'User interface: We spent two yea'
      type: TextQuoteSelector
    source: https://arxiv.org/pdf/2210.07188.pdf
  text: ezCoref presents clusters of coreferences all at the same time - this is a
    nice efficient way to do annotation versus pairwise annotation (like we did for
    CD^2CR)
  updated: '2022-11-23T19:56:25.933796+00:00'
  uri: https://arxiv.org/pdf/2210.07188.pdf
  user: acct:ravenscroftj@hypothes.is
  user_info:
    display_name: James Ravenscroft
in-reply-to: https://arxiv.org/pdf/2210.07188.pdf
tags:
- coreference
- data-annotation
- NLProc
- hypothesis
type: reply
url: /replies/2022/11/23/1669233385

---



 <blockquote>Annotation structure: Two annotation ap-proaches are prominent in the literature: (1) a localpairwise approach, annotators are shown a pairof mentions and asked whether they refer to thesame entity (Hladká et al., 2009; Chamberlain et al.,2016a; Li et al., 2020; Ravenscroft et al., 2021),which is time-consuming; or (2) a cluster-basedapproach (Reiter, 2018; Oberle, 2018; Bornsteinet al., 2020), in which annotators group all men-tions of the same entity into a single cluster. InezCoref we use the latter approach, which can befaster but requires the UI to support more complexactions for creating and editing cluster structures.</blockquote>ezCoref presents clusters of coreferences all at the same time - this is a nice efficient way to do annotation versus pairwise annotation (like we did for CD^2CR)