Why AI language models choke on too much text

Quick Summary:

Compute costs scale with the square of the input size.That's not great.

This limited the size and complexity of tasks ChatGPT could handle.

That works out to roughly 6,000 words of text.

---

More Pictures

---

Read Quick SummarySave Time

or

Article Details

Author / Journalist: Timothy B. Lee

Category: Technology

Markets: United StatesIsraelOman

Topics: LLMs Anthropic AI Features Google deepmind Openai Context windows

Source Website Secure: Yes (HTTPS)

News Sentiment: Neutral

Fact Checked: Legitimate

Article Type: News Report

Published On: 2024-12-20 @ 13:00:56 (1 days ago)

News Timezone: GMT -5:00

News Source URL: arstechnica.com

Language: English

Article Length: 109 words

Reading Time: 1 minutes read

Sentences: 156 lines

Sentence Length: 1 words per sentence (average)

Platforms: Desktop Web, Mobile Web, iOS App, Android App

Copyright Owner: © Ars Technica

News ID: 24570590

View Article Analysis

About Ars Technica

Main Topics: Technology

Official Website: arstechnica.com

Update Frequency: 9 posts per day

Year Established: 1998

Headquarters: United States

News Last Updated: 18 hours ago

Coverage Areas: United States

Ownership: Independent Company

Publication Timezone: GMT -5:00

Content Availability: Worldwide

News Language: English

RSS Feed: Available (XML)

API Access: Available (JSON, REST)

Website Security: Secure (HTTPS)

Publisher ID: #32

Publisher Details

Frequently Asked Questions