Advanced Web Scraping with Python using Scrapy & Splash
Master advanced web scraping with Scrapy & Splash. Learn powerful crawling techniques to extract data efficiently. Level up your web scraping skills!
Course Content
Advanced Web Scraping with Python using Scrapy & Splash is an advanced Udemy course taught by Ahmed Rafik. It runs 5h 30m, is taught in English, and includes a certificate of completion. Learners rate it 4.5 out of 5 from 499 reviews, with 7,275 students enrolled. It is a paid course, last updated August 2020.
Dive into advanced web scraping techniques with Python! This course focuses on practical Scrapy and Splash projects, designed for those with existing experience in web scraping, Scrapy, Splash, and XPath expressions. We bypass introductory material and jump directly into real-world scenarios.
What you'll master:
- Advanced Scrapy & Splash: Go beyond the basics and tackle complex web scraping challenges.
- Requests Chaining: Understand and implement complex request sequences for reliable data retrieval.
- Website Analysis for Scraping: Learn to analyze websites to select the optimal tools and maximize scraping performance.
- Splash Script Optimization: Improve Splash script efficiency by minimizing unnecessary requests and preventing 504 Gateway Timeout errors.
- Splash Cluster with Load Balancing (HAProxy): Build a robust Splash infrastructure to avoid overload and ensure consistent scraping.
- Data Processing with Input/Output Processors: Clean and transform scraped data for high-quality feeds.
- Real-time Data Fetching with ScrapyRT: Build ScrapyRT spiders for immediate data acquisition.
- Web Scraping Freelancing with ScrapyRT & Flask: Showcase your data with a minimalist web app, ideal for freelance projects.
- ReCaptcha Bypass Techniques: Learn proven methods to simulate human-like browser requests and avoid Google ReCaptcha challenges (without relying on Scrapy to solve it).
- Clean & Structured Spider Development: Write maintainable and efficient Scrapy spiders.
- Desktop Application Creation with Tkinter: Develop a user-friendly desktop app to manage and execute your Scrapy spiders, including feed type, location, and naming options – a valuable asset for web scraping freelancers.
This course is designed for focused learners ready to build high-performing spiders. You'll gain the skills to create "User-Friendly" spiders with a Graphical User Interface (GUI) or web apps, significantly increasing your value as a web scraping freelancer. Let's extract valuable data from the web together!
Need a web app built? Hire the team behind TutorialSearch.io
We ship fast, production-grade full-stack apps (Next.js, React, edge infra) — the same stack that powers this site.