Rap Libraries

Scrapy is a BSD-licensed fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, fro…

Minimal and clean example implementations of data structures and algorithms in Python 3. For running all tests write down: For running some specific tests you can do this as following (Ex: sort): For…

Saleor is a rapidly-growing open-source e-commerce platform that serves high-volume companies. Designed from the ground up to be extensible, headless, and composable. Saleor is free and always will b…

Input encrypted text, get the decrypted text back. "What type of encryption?" That's the point. You don't know, you just know it's possibly encrypted. Ciphey will figure it out for you. Ciphey can so…

As developers, we spend our days with code. The site you're reading this on is mostly modules, packages, libraries, frameworks, and the like. But users see applications. When building our own applica…

ERP made simple ERPNext as a monolith includes the following areas for managing businesses: Login for the PWD site: (username: Administrator, password: admin) New passwords will be created for the E…

Have ideas for how pytube can be improved? Feel free to open an issue or a pull request! To install from PyPI with pip: Sometimes, the PyPI release becomes slightly outdated. To install from the sour…

Python Script for 'searching' and 'downloading' hundreds of Google images to the local hard disk! This program lets you download tons of images from Google. Please do not download or use any image th…

instagram-scraper is a command-line application written in Python that scrapes and downloads an instagram user's photos and videos. Use responsibly. To install instagram-scraper: To update instagram-…

Login for the PWD site: (username: Administrator, password: admin) By contributing to Frappe, you agree that your contributions will be licensed under its MIT License.

Graphite consists of three major components:

It's compatible with python 3. Say we want to fetch all related post titles in a stackoverflow page: Here's the output: Say we want to scrape live stock prices from yahoo finance: Now we can get the …

It provides a web interface that allows you to monitor services (e.g. "Stage Redis server", "Production ElasticSearch cluster") and send telephone, sms or hipchat/email alerts to your on-duty team if…

The list of tools, programming libraries and web services used in web scraping and data processing. These two links point to same captcha service, it is just a different language versions

In the interest of fostering an open and welcoming environment, we as contributors and maintainers pledge to making participation in our project and our community a harassment-free experience for eve…

You will be asked about your basic info (name, project name, app name, etc.). This info will be used in your new project. MIT licensed. Thanks @andreoliw for these contributions.

Graphene-Django is an open-source library that provides seamless integration between Django, a high-level Python web framework, and Graphene, a library for building GraphQL APIs. The library allows d…

To install the package use: Or install with pandas support, simply install pandas too: If you want to install from source, then use: Internally there is a retries counter, that can be used to minimiz…

VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution. The preferred way to install VizTracer is via pip Assume you have a python script…

Litestar is a powerful, flexible yet opinionated ASGI framework, focused on building APIs, and offers high-performance data validation and parsing, dependency injection, first-class ORM integration, …

This can be useful if you wish to scrape or crawl a website protected with Cloudflare. Cloudflare's anti-bot page currently just checks if the client supports Javascript, though they may add addition…

Python GraphQL library based on dataclasses The quick start method provides a server and CLI to get going quickly. Install with: To run the debug server run the following command: This will open Grap…

This gets you a ASGI app, with a production static files server pre-installed, jinja2 templating (without additional imports), and a production webserver based on uvloop, serving up requests with gzi…

This gets you a ASGI app, with a production static files server pre-installed, jinja2 templating (without additional imports), and a production webserver based on uvloop, serving up requests with gzi…

Optionally you can now use environment variables to override values per execution or per environment.

Mapnik is an open source toolkit for developing mapping applications. At the core is a C++ shared library providing algorithms and patterns for spatial data access and visualization. Mapnik is basica…

This can be useful if you wish to scrape or crawl a website protected with Cloudflare. Cloudflare's anti-bot page currently just checks if the client supports JavaScript, though they may add addition…

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. Gerapy is developed based on Python 3.x. Python 2.x may be supported later. Install …