---
date: '2023-03-21T19:59:42'
hypothesis-meta:
  created: '2023-03-21T19:59:42.317507+00:00'
  document:
    title:
    - 2303.09752.pdf
  flagged: false
  group: __world__
  hidden: false
  id: 63md-sgiEe2GA2OJo26mSA
  links:
    html: https://hypothes.is/a/63md-sgiEe2GA2OJo26mSA
    incontext: https://hyp.is/63md-sgiEe2GA2OJo26mSA/arxiv.org/pdf/2303.09752.pdf
    json: https://hypothes.is/api/annotations/63md-sgiEe2GA2OJo26mSA
  permissions:
    admin:
    - acct:ravenscroftj@hypothes.is
    delete:
    - acct:ravenscroftj@hypothes.is
    read:
    - group:__world__
    update:
    - acct:ravenscroftj@hypothes.is
  tags:
  - llm
  target:
  - selector:
    - end: 2402
      start: 2357
      type: TextPositionSelector
    - exact: This paper presents COLT5 (ConditionalLongT5)
      prefix: s are processed by aheavier MLP.
      suffix: ', a new family of models that, b'
      type: TextQuoteSelector
    source: https://arxiv.org/pdf/2303.09752.pdf
  text: CoLT5 stands for Conditional LongT5
  updated: '2023-03-21T19:59:42.317507+00:00'
  uri: https://arxiv.org/pdf/2303.09752.pdf
  user: acct:ravenscroftj@hypothes.is
  user_info:
    display_name: James Ravenscroft
in-reply-to: https://arxiv.org/pdf/2303.09752.pdf
tags:
- llm
- hypothesis
type: annotation
url: /annotations/2023/03/21/1679428782

---



 <blockquote>This paper presents COLT5 (ConditionalLongT5)</blockquote>CoLT5 stands for Conditional LongT5