The Wayback Machine's First Crawl
(2021-08-06)
2021-08-06 • •
The Wayback Machine's First Crawl (2021-08-06)
2021-08-06 • •
Overview
In October of 1996, engineers at the the San Francisco-based Internet Archive launched their first web crawlers, taking snapshots of web pages. At the time, the World Wide Web was only 2.5 terabytes in size.
Overview
In October of 1996, engineers at the the San Francisco-based Internet Archive launched their first web crawlers, taking snapshots of web pages. At the time, the World Wide Web was only 2.5 terabytes in size.
