Парсинг и анализ данных на Python: от азов до автоматизации

Unlock the Power of Data: A Comprehensive ITtensive Course

Note: To access the ITtensive courses on Udemy, please email [email protected] with the name of the course or courses you wish to enroll in.

This course is structured into four key modules, providing you with a complete skillset in data analysis, data scraping, data visualization, and report automation.

1. Data Analysis with Python

Master the essential techniques for working with data using Python and the powerful pandas library. You'll learn how to:

• Import, combine, transform, and filter data from various sources.
• Predict trends and gain valuable insights from your data.
• Load data from CSV, TSV, and Excel files.
• Extract key values and identify relationships between datasets.
• Clean and manipulate datasets to prepare them for analysis.
• Apply linear regression to uncover linear correlations and forecast future values.

2. Web Data Scraping with Python

Dive into the world of web scraping with Python! This module covers:

• Data acquisition using the requests library and handling JSON and XML (including SOAP) data formats.
• Extracting data from unstructured HTML and transforming it into structured data frames.
• Scraping entire websites using multi-threading for efficient data collection. You'll build a multi-process spider bot.
• Storing scraped data in a SQLite database and querying it directly into data frames.

3. Data Visualization for Insights

Bring your data to life with compelling visualizations! You'll explore:

• matplotlib fundamentals and various chart types (lines, areas, bars, pie charts).
• seaborn for advanced statistical visualizations: create box plots, pair plots, and distribution plots.
• Time series data visualization: master line charts, moving averages, deviations, and candlestick charts.
• Geospatial data visualization using geopandas to create informative map overlays.

4. Report Generation and Automation

Automate your data workflows with Python! This module focuses on:

• Creating and manipulating PDF documents using libraries like reportlab and pypdf2.
• Generating PDFs from HTML using templating with jinja2 and pdfkit.
• Automating report delivery via email using smtplib and email.
• Converting binary data to base64 encoding.
• Combining and splitting PDF documents.
• Working with HTML and PDF documents through a canvas.

This course provides practical solutions for generating dynamic reports and streamlining your data-driven tasks. Libraries covered include reportlab, pypdf2, pdfkit, jinja2, smtplib, email, binascii, io, and the binary file wkhtmltopdf.