Scraper Libraries

79 Components & Libraries

Sortby

Scraper Libraries

A python bot to automatically apply all Linkedin,Glassdoor, etc Easy Apply jobs based on your preferences. Auto login, auto fill additional questions, apply automatically!

Easy Apply Jobs Bot Pro version running on Linux Firefox Browser Easy Apply Jobs Bot Pro version running on Linux Chrome Browser There are several features and simplifications we'd like to add to thi…

Python's package to scrap Twitter's front-end easily

Python's package to scrape Twitter's front-end easily with selenium. Download the source code or clone it with: Open terminal inside the downloaded folder: Note: HTTP Request Method sends the r…

Open source toolkit for scraping, OSINT and more.

Toolkit for scraping, OSINT and more. Some tools might not work on Windows systems. -IG Scrape requires you to log in, in order to use it. -SMS Bomber only works with US numbers. -You might get rate …

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex. Python is arguably…

Instagram AI bot with face detection. It works without instagram api, need only login and password.

Instabotai is an instagram bot with face detection that uses the undocumented Web API. Instabotai can reupload photo to feed, reupload photo to stories, watch stories, comment, like and DM users if a…

Uscrapper 2.0, a powerful OSINT webscraper for personal data collection. Uscrapper uses web scraping to extract email IDs, social-media links, geolocations, phone numbers, and usernames from webpages, supports multithreading, has advanced Anti-webscraping bypassing modules, supports webcrawling to scrape from various sublinks within the same domain

Uscrapper extracts the following details from the provided website: Uscrapper 2.0: To run Uscrapper, use the following command-line syntax: Uscrapper relies on web scraping techniques to extract i…

🐙 Get Daily 400-500 Real Followers 👽 [BadRobo] is Best Instagram Bot Available Now with All Features!. Our BOT did not violate any of Instagram's rules, so you don't have to worry about getting ACTION BLOCK!

Step 1 (Clone or Download) Step 2 (Open Bad-Robo Drectory) Step 3 (Unzip BadRobo) Step 4 (Install BadRobo Requirements > This Take Some time 10-15 mints ) Step 5 (Run BadRobo) Step 1 (Remove insta…

Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object

Version 1.1 is available to install via Pip: Run the search on the rightmove website and copy the URL of the first results page. Create an instance of the class with the URL as the init argument. Fin…

A playwright bot which is implemented to scrape linkedin and store advertisement data in a database and telegram channel

Built for developers, by developers. The Playwright-LinkedIn-Scraper is a tool that automates the process of collecting job postings, internships, and other opportunities from LinkedIn. It does this …

sec.gov EDGAR API | search & filter SEC filings | over 150 form types supported | 10-Q, 10-K, 8, 4, 13, S-11, ... | insider trading

You can use the API in your command line, or develop your own application using the API as imported package. Both options are explained below. The query API allows you to search and filter all 18 mil…

ScrapPY is a Python utility for scraping manuals, documents, and other sensitive PDFs to generate wordlists that can be utilized by offensive security tools to perform brute force, forced browsing, and dictionary attacks against targets. The tool dives deep to discover keywords and phrases leading to potential passwords or hidden directories.

ScrapPY is a Python utility for scraping manuals, documents, and other sensitive PDFs to generate targeted wordlists that can be utilized by offensive security tools to perform brute force, forced br…

Python library to download bulk of images from Bing.com

This program lets you download tons of images from Bing. Please do not download or use any image that violates its copyright terms. or

🕵️ Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.

Metadata, in the realm of cybersecurity, is more than just embedded information; it's a gateway to insightful perspectives, often unveiling crucial leads in OSINT and pentesting. Drawing inspiration …

Learn everything web scraping with David Teather Codes on YouTube

If you don't want to deal with installing and configuring software, I've set up this repository so that a GitHub Codespace can do all of that for you. Select Code -> Codespaces Tab -> The + Ico…

Get all videos from a youtube channel, get all videos from a playlist, get all videos that match a search

This module will help you scrape youtube without the official youtube api and without selenium. With this module you can: Here's a few short code examples.

🤖 Increase your followers on Instagram with IGFI 📈

Contributions are always welcome ! Answer ➡️ No, not at all! It's similar to asking if following and unfollowing an account is illegal, even though Instagram doesn't recommend using this technique to…

✨ Bose is a a feature-rich Python framework for Web Scraping and Bot Development. 🤖

🚀 Swiss Army Knife for Bot Development 🤖 👋 Hello, I've made A LOT of bots in my life. I have written messaging bots to message people on fiverr and linkedin promoting my services. Bots's that scraped…

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

I am working on command line argument version where you will be able to download selected stocks with this snippet too. This script can run on multiple Operating Systems. Follow the instructions ment…

Jbin will gather all the URLs from the website and then it will try to expose the secret data from them such as API keys, API secrets, API tokens and many other juicy information.

Jbin will gather all the URLs from the website and then it will try to expose the secret data from them. It collects both URLs and JS links to scrape secrets out of it. Also if you are looking for a …

A web crawler (for bug hunting) that gathers more than you can imagine.

N.Y.A.W.C is a Python library that enables you to test your payload against all requests of a certain domain. It crawls all requests (e.g. GET, POST or PUT) in the specified scope and keeps track of …

automate instagram activities using instagram bot - like follow/unfollow comment; python requests lib

estela, an elastic web scraping cluster 🕸

The project consists of three main modules: Each of these modules works independently of the rest and can be changed. Each module has a more detailed description in its corresponding directory.

Social media research and promotion, semi-autonomous CLI bot

A python command-line (CLI) bot for automating research and promotion on popular social media platforms (reddit, twitter, facebook, [TODO: instagram]). With a single command, scrape social media site…

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

This is a Webcrawler based on Scrapy and Selenium frameworks This spider crawls thru the directferries.com website in order to generate a json file with all tickets available for one of these directi…

Python Library to download images and metadata from popular search engines.

A simple python package for saving images from Bing and Google without using API keys. This package utilizes web browsers to help scrape images found on web searches. This should only be used for edu…