diff --git a/README.md b/README.md index 0d87610..1316cb9 100644 --- a/README.md +++ b/README.md @@ -1144,6 +1144,7 @@ _Libraries to automate web scraping._ - [browser-use](https://github.com/browser-use/browser-use) - Make websites accessible for AI agents with easy browser automation. - [feedparser](https://github.com/kurtmckee/feedparser) - Universal feed parser. +- [crawl4ai](https://github.com/unclecode/crawl4ai) - An open-source, LLM-friendly web crawler that provides lightning-fast, structured data extraction specifically designed for AI agents. - [grab](https://github.com/lorien/grab) - Site scraping framework. - [mechanicalsoup](https://github.com/MechanicalSoup/MechanicalSoup) - A Python library for automating interaction with websites. - [scrapy](https://github.com/scrapy/scrapy) - A fast high-level screen scraping and web crawling framework.