No cover art

Udemy - Scrapy masterclass - Python web scraping and data pipelines

Other
Size
2.8 GB
Seeders
11
Leechers
1
Files
98
Category
Other
Added
11/28/22 at 8:11pm GMT+1
Infohash
5b7abca8f5b0a0f26de1fe05cea61f3654ee8874

Description
[ DevCourseWeb.com ] Scrapy masterclass: Python web scraping and data pipelines



If You Need More Stuff, kindly Visit and Support Us -->> https://DevCourseWeb.com







Published 11/2022

Created by Ahmed Elfakharany

MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz, 2 Ch

Genre: eLearning | Language: English | Duration: 40 Lectures ( 5h 44m ) | Size: 2.75 GB



Work on 7 real-world web-scraping projects using Scrapy, Splash, and Selenium. Build data pipelines locally and on AWS



What you'll learn

Extract data from the most difficult web sites using Scrapy

Build ETL pipelines and store data in CSV, JSON, MySQL, MongoDB, and S3

Avoid getting banned and evade bot-protection techniques

Use Splash for scraping JavaScript-powered websites

Harness the power of Selenium browser automation to scrape any website

Deploy your Scrapy bots in local and AWS environments



Requirements

Some Python background

All projects are run on Python 3.10 so it needs to be installed

Familiarity with Linux is recommended but not strictly required

Familiarity with the HTTP protocol and HTML



If You Need More Stuff, kindly Visit and Support Us -->> https://CourseWikia.com



Get More Tutorials and Support Us -->> https://FreeCourseWeb.com



We upload these learning materials for the people from all over the world, who have the talent and motivation to sharpen their skills/ knowledge but do not have the financial support to afford the materials. If you like this content and if you are truly in a position that you can actually buy the materials, then Please, we repeat, Please, Support Authors. They Deserve it! Because always remember, without "Them", you and we won't be here having this conversation. Think about it! Peace...



Image error



Image error

File list
  • Udemy - Scrapy masterclass - Python web scraping and data pipelines
  • ~Get Your Files Here !/1. Introduction/1. Introduction.mp4 61.5 MB
  • ~Get Your Files Here !/1. Introduction/1. Introduction.srt 13.7 KB
  • ~Get Your Files Here !/1. Introduction/1.1 Resources.html 128 B
  • ~Get Your Files Here !/1. Introduction/2. Scrapy installation.html 2.8 KB
  • ~Get Your Files Here !/2. Xpath first steps/1. Xpath 101 node types.mp4 39 MB
  • ~Get Your Files Here !/2. Xpath first steps/1. Xpath 101 node types.srt 13.7 KB
  • ~Get Your Files Here !/2. Xpath first steps/1.1 xpath_node_types.png 1.2 MB
  • ~Get Your Files Here !/2. Xpath first steps/2. Xpath 102 basic syntax.mp4 70.9 MB
  • ~Get Your Files Here !/2. Xpath first steps/2. Xpath 102 basic syntax.srt 22.1 KB
  • ~Get Your Files Here !/2. Xpath first steps/2.1 XPath 102 Cheat Sheet.pdf 64 KB
  • ~Get Your Files Here !/2. Xpath first steps/3. XPath 103 Axes (Node Relations).mp4 43.4 MB
  • ~Get Your Files Here !/2. Xpath first steps/3. XPath 103 Axes (Node Relations).srt 14.4 KB
  • ~Get Your Files Here !/2. Xpath first steps/3.1 XPath 103 Cheat Sheet Axes (node relations).pdf 51.5 KB
  • ~Get Your Files Here !/2. Xpath first steps/4. Revisiting our real-estate web scraping example.mp4 76.1 MB
  • ~Get Your Files Here !/2. Xpath first steps/4. Revisiting our real-estate web scraping example.srt 14.1 KB
  • ~Get Your Files Here !/3. Hello Scrapy/1. What is a web bot Is it ethical.mp4 48.4 MB
  • ~Get Your Files Here !/3. Hello Scrapy/1. What is a web bot Is it ethical.srt 14.4 KB
  • ~Get Your Files Here !/3. Hello Scrapy/2. The Scrapy Shell.mp4 68.5 MB
  • ~Get Your Files Here !/3. Hello Scrapy/2. The Scrapy Shell.srt 19.4 KB
  • ~Get Your Files Here !/3. Hello Scrapy/3. Creating your first Scrapy project.mp4 69.3 MB
  • ~Get Your Files Here !/3. Hello Scrapy/3. Creating your first Scrapy project.srt 18 KB
  • ~Get Your Files Here !/3. Hello Scrapy/3.1 Create your own Scrapy project.html 139 B
  • ~Get Your Files Here !/3. Hello Scrapy/4. Creating your first Scrapy spider.mp4 88.2 MB
  • ~Get Your Files Here !/3. Hello Scrapy/4. Creating your first Scrapy spider.srt 19.2 KB
  • ~Get Your Files Here !/3. Hello Scrapy/4.1 Create your own Scrapy spider.html 138 B
  • ~Get Your Files Here !/3. Hello Scrapy/5. Handling combined queries using the getall() method.mp4 60.3 MB
  • ~Get Your Files Here !/3. Hello Scrapy/5. Handling combined queries using the getall() method.srt 10.8 KB
  • ~Get Your Files Here !/3. Hello Scrapy/5.1 Combining XPath queries.html 139 B
  • ~Get Your Files Here !/3. Hello Scrapy/6. Data cleansing using Item Loaders.mp4 114.5 MB
  • ~Get Your Files Here !/3. Hello Scrapy/6. Data cleansing using Item Loaders.srt 27.5 KB
  • ~Get Your Files Here !/3. Hello Scrapy/6.1 Item Loaders.html 128 B
  • ~Get Your Files Here !/3. Hello Scrapy/6.2 The Scrapy project.html 128 B
  • ~Get Your Files Here !/3. Hello Scrapy/7. Pagination and link-following using Crawl Spiders.mp4 99 MB
  • ~Get Your Files Here !/3. Hello Scrapy/7. Pagination and link-following using Crawl Spiders.srt 17.9 KB
  • ~Get Your Files Here !/3. Hello Scrapy/7.1 Crawl Spiders.html 137 B
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/1. Login to websites.mp4 45.9 MB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/1. Login to websites.srt 15.3 KB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/1.1 Login bot.html 121 B
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/2. Changing the user-agent.mp4 26.8 MB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/2. Changing the user-agent.srt 6.5 KB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/3. Handling AJAX requests 1.mp4 70.2 MB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/3. Handling AJAX requests 1.srt 17.2 KB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/3.1 Handling AJAX requests.html 129 B
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/4. Handling AJAX requests 2.mp4 45.9 MB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/4. Handling AJAX requests 2.srt 9.2 KB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/4.1 Handling AJAX requests.html 129 B
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/5. Handling AJAX requests 3.mp4 38.2 MB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/5. Handling AJAX requests 3.srt 7.1 KB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/5.1 Handling AJAX requests.html 129 B
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/6. Caching responses.mp4 60.9 MB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/6. Caching responses.srt 13 KB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/7. Image harvesting.mp4 147.1 MB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/7. Image harvesting.srt 24.1 KB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/8. Scraped images storage in FTP and AWS S3.mp4 43.6 MB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/8. Scraped images storage in FTP and AWS S3.srt 9.7 KB
  • ~Get Your Files Here !/4. Scrapy web-scraping scenarios/8.1 Images storage to S3 and FTP.html 138 B
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/1. Introduction and sample project (classifieds ads scraping).mp4 140.2 MB
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/1. Introduction and sample project (classifieds ads scraping).srt 29.3 KB
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/1.1 Classifieds Ads project.html 135 B
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/2. Removing ads with duplicate titles.mp4 42.3 MB
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/2. Removing ads with duplicate titles.srt 8.6 KB
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/2.1 Remove duplicates pipeline.html 143 B
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/2.2 Removing duplicates pipeline.html 135 B
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/3. Removing ads with no phone numbers.mp4 28 MB
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/3. Removing ads with no phone numbers.srt 5.5 KB
  • ~Get Your Files Here !/5. Data transformation using Scrapy Pipelines/3.1 Dropping Ads with no phones pipeline.html 139 B
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/1. Storing scraped data in MongoDB.mp4 66 MB
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/1. Storing scraped data in MongoDB.srt 19.5 KB
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/1.1 MongoDB pipeline.html 132 B
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/2. Storing scraped data in MySQL.mp4 74.9 MB
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/2. Storing scraped data in MySQL.srt 16.6 KB
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/2.1 MySQL Pipeline.html 130 B
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/3. Using Vault to sore sensitive Scrapy settings.mp4 73 MB
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/3. Using Vault to sore sensitive Scrapy settings.srt 17.3 KB
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/3.1 Using Vault to store sensitive data for Scrapy.html 129 B
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/4. Storing data to AWS S3 bucket.mp4 58.1 MB
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/4. Storing data to AWS S3 bucket.srt 14.6 KB
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/4.1 S3 Pipeline.html 127 B
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/5. Using Amazon Glue and Athena to query the data from S3 (extra lecture).mp4 59.8 MB
  • ~Get Your Files Here !/6. Data loading (storage) using Scrapy's pipelines/5. Using Amazon Glue and Athena to query the data from S3 (extra lecture).srt 13.1 KB
  • ~Get Your Files Here !/7. Scrapy Middleware (or how to avoid getting banned)/1. Phone-models project and spider rate-limiting.mp4 124.2 MB
  • ~Get Your Files Here !/7. Scrapy Middleware (or how to avoid getting banned)/1. Phone-models project and spider rate-limiting.srt 24.2 KB
  • ~Get Your Files Here !/7. Scrapy Middleware (or how to avoid getting banned)/1.1 Phone Models Project.html 136 B
  • ~Get Your Files Here !/7. Scrapy Middleware (or how to avoid getting banned)/2. Rotating user-agents middleware.mp4 52.2 MB
  • ~Get Your Files Here !/7. Scrapy Middleware (or how to avoid getting banned)/2. Rotating user-agents middleware.srt 10.4 KB
  • ~Get Your Files Here !/7. Scrapy Middleware (or how to avoid getting banned)/2.1 Rotating user-agents project.html 143 B
  • ~Get Your Files Here !/7. Scrapy Middleware (or how to avoid getting banned)/3. Rotating proxies middleware.mp4 83.5 MB
  • ~Get Your Files Here !/7. Scrapy Middleware (or how to avoid getting banned)/3. Rotating proxies middleware.srt 16 KB
  • ~Get Your Files Here !/7. Scrapy Middleware (or how to avoid getting banned)/3.1 Rotating proxies.html 140 B
  • ~Get Your Files Here !/8. Handling JavaScript websites using Splash/1. What is Splash.mp4 32.5 MB
  • ~Get Your Files Here !/8. Handling JavaScript websites using Splash/1. What is Splash.srt 10.9 KB
  • ~Get Your Files Here !/8. Handling JavaScript websites using Splash/2. Introduction to Docker (optional).mp4 54.9 MB
  • ~Get Your Files Here !/8. Handling JavaScript websites using Splash/2. Introduction to Docker (optional).srt 18.9 KB
  • ~Get Your Files Here !/8. Handling JavaScript websites using Splash/3. Test-driving Splash.mp4 43.7 MB
  • ~Get Your Files Here !/8. Handling JavaScript websites using Splash/3. Test-driving Splash.srt 10.4 KB
  • ~Get Your Files Here !/8. Handling JavaScript websites using Splash/4. Integrating Scrapy with Splash.mp4 112 MB
  • ~Get Your Files Here !/8. Handling JavaScript websites using Splash/4. Integrating Scrapy with Splash.srt 22.1 KB
  • ~Get Your Files Here !/8. Handling JavaScript websites using Splash/4.1 Wikipedia with Splash.html 133 B

Rating
Not rated yet
Log in to rate

Comments

No comments yet.


Similar torrents
NameSizeDate
15 MB07/19/2648763245
15 MB07/19/2648713243
18 MB07/19/2646523107
6 MB07/18/2645563035
50 MB07/14/2644592968
43 MB07/13/2644412963
18 MB07/15/2644102941
15 MB07/16/2643952928
7 MB07/16/2643842921
9 MB07/15/2643402888
14 MB07/19/2643292885
14 MB07/15/2642642837
6 MB12/31/2541332756
8 MB08/10/2633892257
15 MB08/10/2633662244