--- date: '2023-01-29T10:53:23' hypothesis-meta: created: '2023-01-29T10:53:23.198884+00:00' document: title: - 2301.11305.pdf flagged: false group: __world__ hidden: false id: JoZDmp_DEe2QSbcSZI0WEA links: html: https://hypothes.is/a/JoZDmp_DEe2QSbcSZI0WEA incontext: https://hyp.is/JoZDmp_DEe2QSbcSZI0WEA/arxiv.org/pdf/2301.11305.pdf json: https://hypothes.is/api/annotations/JoZDmp_DEe2QSbcSZI0WEA permissions: admin: - acct:ravenscroftj@hypothes.is delete: - acct:ravenscroftj@hypothes.is read: - group:__world__ update: - acct:ravenscroftj@hypothes.is tags: - chatgpt - detecting gpt target: - selector: - end: 27924 start: 27657 type: TextPositionSelector - exact: We find that supervised detectors can provide similardetection performance to DetectGPT on in-distribution datalike English news, but perform significantly worse than zero-shot methods in the case of English scientific writing andfail altogether for German writing. T prefix: 'm each dataset for evalua-tion. ' suffix: his finding echoes pastwork show type: TextQuoteSelector source: https://arxiv.org/pdf/2301.11305.pdf text: supervised detection methods fail on out of domain examples whereas detectgpt seems to be robust to changes in domain. updated: '2023-01-29T10:53:23.198884+00:00' uri: https://arxiv.org/pdf/2301.11305.pdf user: acct:ravenscroftj@hypothes.is user_info: display_name: James Ravenscroft in-reply-to: https://arxiv.org/pdf/2301.11305.pdf tags: - chatgpt - detecting gpt - hypothesis type: annotation url: /annotations/2023/01/29/1674989603 ---
We find that supervised detectors can provide similardetection performance to DetectGPT on in-distribution datalike English news, but perform significantly worse than zero-shot methods in the case of English scientific writing andfail altogether for German writing. T
supervised detection methods fail on out of domain examples whereas detectgpt seems to be robust to changes in domain.