brainsteam.co.uk/brainsteam/content/annotations/2023/01/29/1674989603.md

date	hypothesis-meta	in-reply-to	tags	type	url
2023-01-29T10:53:23	created document flagged group hidden id links permissions tags target text updated uri user user_info 2023-01-29T10:53:23.198884+00:00 title 2301.11305.pdf false __world__ false JoZDmp_DEe2QSbcSZI0WEA html incontext json https://hypothes.is/a/JoZDmp_DEe2QSbcSZI0WEA https://hyp.is/JoZDmp_DEe2QSbcSZI0WEA/arxiv.org/pdf/2301.11305.pdf https://hypothes.is/api/annotations/JoZDmp_DEe2QSbcSZI0WEA admin delete read update acct:ravenscroftj@hypothes.is acct:ravenscroftj@hypothes.is group:__world__ acct:ravenscroftj@hypothes.is chatgpt detecting gpt selector source end start type 27924 27657 TextPositionSelector exact prefix suffix type We find that supervised detectors can provide similardetection performance to DetectGPT on in-distribution datalike English news, but perform significantly worse than zero-shot methods in the case of English scientific writing andfail altogether for German writing. T m each dataset for evalua-tion. his finding echoes pastwork show TextQuoteSelector https://arxiv.org/pdf/2301.11305.pdf supervised detection methods fail on out of domain examples whereas detectgpt seems to be robust to changes in domain. 2023-01-29T10:53:23.198884+00:00 https://arxiv.org/pdf/2301.11305.pdf acct:ravenscroftj@hypothes.is display_name James Ravenscroft	https://arxiv.org/pdf/2301.11305.pdf	chatgpt detecting gpt hypothesis	annotation	/annotations/2023/01/29/1674989603

We find that supervised detectors can provide similardetection performance to DetectGPT on in-distribution datalike English news, but perform significantly worse than zero-shot methods in the case of English scientific writing andfail altogether for German writing. T

supervised detection methods fail on out of domain examples whereas detectgpt seems to be robust to changes in domain.