This AI Agent can Scrape ANY WEBSITE!!!
In this video, we'll create a python script together that can scrape any website with only minor modifications
________ ๐ Links ๐ ________
๐ค Discord: https://discord.gg/jUe948xsv4
๐ผ ๐๐ถ๐ป๐ธ๐ฒ๐ฑ๐๐ป: https://www.linkedin.com/in/reda-marzouk-rpa/
๐ธ ๐๐ป๐๐๐ฎ๐ด๐ฟ๐ฎ๐บ: https://www.instagram.com/redamarzouk.rpa/
๐ค ๐ฌ๐ผ๐๐ง๐๐ฏ๐ฒ: https://www.youtube.com/@redamarzouk/videos
Website: https://www.automation-campus.com/
FireCrawl: https://www.firecrawl.dev/
Github repo: https://github.com/redamarzouk/Scraping_Agent
________ ๐ Content๐ ________
Introduction to Web Scraping with AI - 0:00
Advantages Over Traditional Methods - 0:36
Overview of FireCrawl Library - 1:13
Setting Up FireCrawl Account and API Key - 1:24
Scraping with FireCrawl : Example and Explanation - 1:36
Universal Web Scraping Agent Workflow - 2:33
Setting Up the Project in VS Code - 3:52
Writing the Scrape Data Function - 5:41
Formatting and Saving Data - 6:58
Running the Code: First Example - 10:14
Handling Large Data and Foreign Languages - 13:17
Conclusion and Recap - 17:21
Posted May 31
click to rate
Share this page with your family and friends.