We are very happy to announce that the March 2026 crawl archive is now available.
Increase in IPv6 fetches
By upgrading the crawler's HTTP client library OkHttp, the Happy Eyeballs RFC (RFC 6555) was turned on. Happy Eyeballs is an algorithm that lets clients race IPv4 and IPv6 connection attempts simultaneously, with a small head start given to IPv6. Whichever connects first wins, avoiding the long timeouts that would otherwise occur if one protocol is broken or slow. Having this enabled caused an increase of the amount of fetches over IPv6 from 0.5% to around 31%. See the OkHttp Change Log for more information.
We also recently ran an experiment to measure the adoption of IPv6 across the top 100k web hosts, about which you can read in our recent blog post, and see the corresponding data and code in its GitHub repository.
The crawl
The data was crawled between March 5th and March 17th, and contains 1.97 billion web pages (or 344.64 TiB of uncompressed content). Page captures are from 44 million hosts or 36.1 million registered domains and include 600 million new URLs, not visited in any of our prior crawls.
Archive Location & Download
The March 2026 crawl archive is located in the commoncrawl bucket at crawl-data/CC-MAIN-2026-12/.
To assist with exploring and using the dataset, we provide gzipped files which list all segments, WARC, WAT and WET files.
By simply adding either s3://commoncrawl/ or https://data.commoncrawl.org/ to each line, you end up with the S3 and HTTP paths respectively, please see Get Started for detailed instructions.
Erratum:
Content is truncated
Some archived content is truncated due to fetch size limits imposed during crawling. This is necessary to handle infinite or exceptionally large data streams (e.g., radio streams). Prior to March 2025 (CC-MAIN-2025-13), the truncation threshold was 1 MiB. From the March 2025 crawl onwards, this limit has been increased to 5 MiB.
For more details, see our truncation analysis notebook.
.svg)
