Cheap AI “video scraping” can now extract data from any screen recording

Quick Summary:

Researcher feeds screen recordings into Gemini to extract accurate information with ease.

He recorded a 35-second video scrolling through the relevant emails, then fed that video into Google's AI Studio tool, which allows people to experiment with several versions of Google's Gemini 1.5 Pro and Gemini 1.5 Flash AI models.

What he discovered seems simple on its surface, but the quality of the result has deeper implications for the future of AI assistants, which may soon be able to see and interact with what we're doing on our computer screens.

---

More Pictures

---

Read Quick SummarySave Time

or

Article Details

Author / Journalist: Benj Edwards

Category: Technology

Markets: United States

Topics: Multimodal AI AI AI video scraping Simon Willison Multimodal Machine learning Video scraping

Source Website Secure: Yes (HTTPS)

News Sentiment: Neutral

Fact Checked: Legitimate

Article Type: News Report

Published On: 2024-10-17 @ 22:41:39 (12 hours ago)

News Timezone: GMT -5:00

News Source URL: arstechnica.com

Language: English

Article Length: 178 words

Reading Time: 1 minutes read

Sentences: 61 lines

Sentence Length: 3 words per sentence (average)

Platforms: Desktop Web, Mobile Web, iOS App, Android App

Copyright Owner: © Ars Technica

News ID: 23111930

View Article Analysis

About Ars Technica

Main Topics: Technology

Official Website: arstechnica.com

Update Frequency: 14 posts per day

Year Established: 1998

Headquarters: United States

News Last Updated: 10 hours ago

Coverage Areas: United States

Ownership: Independent Company

Publication Timezone: GMT -5:00

Content Availability: Worldwide

News Language: English

RSS Feed: Available (XML)

API Access: Available (JSON, REST)

Website Security: Secure (HTTPS)

Publisher ID: #32

Publisher Details

Frequently Asked Questions