The November December 2023 Common Crawl archive is now available.

3.35 billion web pages and 454 TiB of uncompressed content.

This dataset is perfect for security researchers! I've personally leveraged this dataset in various projects, including @ail_project and DNS analysis. It's a goldmine for insights and innovation.

#opendata #infosec #research #commoncrawl #dataset #science

🔗 https://www.commoncrawl.org/blog/november-december-2023-crawl-archive-now-available