Data collection in Python. Web Scraping with Beautiful Soup, Selenium and Scrapy

thepycoach Last update: Feb 20, 2024

Web Scraping in Python (English/Español)

English 🇺🇸

This repository contains script demos of my Web Scraping Course in Python: BS4, Selenium and Scrapy --> https://www.udemy.com/course/web-scraping-course-in-python-bs4-selenium-and-scrapy/?referralCode=291C4D7FF6F683531933

However, I have published tons of free tutorials on Medium. For example, the link below contains more than 10 web scraping tutorials/guides I made.

https://frank-andrade.medium.com/list/web-scraping-in-python-d19defa033fd

You can find more free content about Python and data science on my Medium articles and YouTube videos.

Medium: https://frank-andrade.medium.com/
YouTube: https://www.youtube.com/c/FrankAndrade5

Spanish 🇪🇸

Este repositorio contiene algunos scripts de mi Curso de Web Scraping en Python: De Cero a Experto --> https://www.udemy.com/course/curso-completo-de-web-scraping-en-python-de-cero-a-experto/?referralCode=8F4DE225290091734DAC

He publicado varios videos de web scraping. Aqui puedes encontrar un playlist de 2 horas de Web Scraping de mi canal de YouTube.

https://youtube.com/playlist?list=PLEnAlfUR3oGdCK5gsjbFPZipT_Sm4Eo11

Puedes encontrar más contenido de Python y ciencia de los datos en mis articulos de Medium y videos de YouTube

Medium (Solo contenido en inglés): https://frank-andrade.medium.com/
YouTube: https://www.youtube.com/c/AndradeFrank/videos

Tags:

Owner

thepycoach

GitHub Repository https://github.com/thepycoach

Web scraping the popular job listing site "Glassdoor" with Python and BeautifulSoup. Implemented from scratch.

This project web scrapes the popular job listing site "Glassdoor" for information from job listings Refer to requirements.txt for a comprehensive list of requirements. The following gif shows how a b…

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex. Python is arguably…

Automatically scrape the web data of people profiles on Linkedin based on a specific search query

Automatically scrape the web data of people profiles on Linkedin based on a specific search query It takes 10s on average to skim through Linkedin profiles and copy that information into an excel she…

Technical and sentiment analysis to predict the stock market with machine learning models based on historical time series data and news article sentiment collected using APIs and web scraping.

Technical and sentiment analysis to predict the stock market. The aim of the project is to investigate the performance of various machine learning models to predict stock market movements based on hi…

🚀 Web scraping for humans

Install via pip: Other dependencies will be downloaded on the first import: Get the response url: Check if the request was successful: Getting the response body: Parse the response body as JSON: Get …

Data collection in Python. Web Scraping with Beautiful Soup, Selenium and Scrapy

However, I have published tons of free tutorials on Medium. For example, the link below contains more than 10 web scraping tutorials/guides I made. You can find more free content about Python and dat…

✨ Bose is a a feature-rich Python framework for Web Scraping and Bot Development. 🤖

🚀 Swiss Army Knife for Bot Development 🤖 👋 Hello, I've made A LOT of bots in my life. I have written messaging bots to message people on fiverr and linkedin promoting my services. Bots's that scraped…

The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

Originally named "Web Scraping Open Project", this repository wants so create a common knowledge among web scraping experts, interesting enough for both rookies and experts in the field. Anyone can s…

Uscrapper 2.0, a powerful OSINT webscraper for personal data collection. Uscrapper uses web scraping to extract email IDs, social-media links, geolocations, phone numbers, and usernames from webpages, supports multithreading, has advanced Anti-webscraping bypassing modules, supports webcrawling to scrape from various sublinks within the same domain

Uscrapper extracts the following details from the provided website: Uscrapper 2.0: To run Uscrapper, use the following command-line syntax: Uscrapper relies on web scraping techniques to extract i…

A web-scraping-based python package that enables you to scrape data from various platforms like GitHub, Twitter, Instagram, or any useful website.

An alternative to APIs, Scrape Up is a Python package for web scraping. It allows you to extract data from platforms like GitHub, Twitter, Instagram, or any other website that contains valuable infor…