146 Components & Libraries
Sortby
Scrapy is a BSD-licensed fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, fro…
Screenshot: django-image-cropping is perfect when you need images with a specific size for your templates but want your users or editors to upload images of any dimension. It presents a selection wit…
Mapnik is an open source toolkit for developing mapping applications. At the core is a C++ shared library providing algorithms and patterns for spatial data access and visualization. Mapnik is basica…
Read more about DDS in the ReadTheDocs documentation: There is a mailing list on Google Groups, feel free to ask questions or make suggestions: Infos about new releases and updates on Twitter:
Basic usage is as follows:
We are always happy to answer questions! Here are some good places to ask them: If you think you've found a bug: To report a bug or request an enhancement: To discuss a new type system feature: Mypy …
Saleor is a rapidly-growing open-source e-commerce platform that serves high-volume companies. Designed from the ground up to be extensible, headless, and composable. Saleor is free and always will b…
This can be useful if you wish to scrape or crawl a website protected with Cloudflare. Cloudflare's anti-bot page currently just checks if the client supports JavaScript, though they may add addition…
I myself have not used Grab for many years. I am not sure it is being used by anybody at present time. Nonetheless I decided to refactor the project, just for fun. I have annotated whole code base wi…
This is a Webcrawler based on Scrapy and Selenium frameworks This spider crawls thru the directferries.com website in order to generate a json file with all tickets available for one of these directi…
Easy to type, click, select, toggle, drag & drop, and more. 💡 SeleniumBase gives you clean error output when a test fails. With raw Selenium, error messages can get very messy. ✅ SeleniumBase use…
A high performance, easy to use, multithreaded command line tool which downloads images from the given webpage. You can also download using pip: You can also use it in your Python scripts. (Deprecate…
Works with any PLY file with 'x, y, z, nx, ny, nz, red, green, blue' vertex values. Vertex normals and colors are optional. Filter current point cloud, all changes are only temporary, original data a…
The primary goal of Scrapple is to abstract the process of designing web content extractors. The focus is laid on what to extract, rather than how to do it. The user-specified configuration file cont…
Pytype checks and infers types for your Python code - without requiring type annotations. Pytype can: Pytype is a static analyzer; it does not execute the code it runs on. Thousands of projects at Go…
Features: Pomp makes no attempt to accomodate: Pomp is written and maintained by Evgeniy Tatarkin and is licensed under the BSD license.
Shuup is an Open Source E-Commerce Platform based on Django and Python. Shuup is International Registered Trademark & Property of Shuup Commerce Inc., Business ID: BC1126729, Business Address: 15…
The list of tools, programming libraries and web services used in web scraping and data processing. These two links point to same captcha service, it is just a different language versions
The following features are available: The optional features dependencies are installed as follows: The figures plotting dependencies are installed as follows: The overall development dependencies are…
Contributed By Check Point Software Technologies LTD. It can be useful in the following cases: We support the following list of debug backends for now: Labeless significantly reduces time that resear…
Installing ODL should be as easy as or ODL is compatible with Python 2/3 and all major platforms (GNU/Linux / Mac / Windows). This is an incomplete list of articles and projects using ODL. If you wan…
Web scraping and automation using python
An online Book Store created with Python / Flask rest, MySql,Angular and Bootstrap Features use of several data structures for optimization techniques A full fledged functionality with Modules like c…
Python codes for robotics algorithm. This is a Python code collection of robotics algorithms. Features: Easy to read for understanding each algorithm's basic idea. Widely used and practical algorithm…
Supported archives include: mailingListScraper is composed of several spiders.Each spider targets a specific email archive, which can host one or several mailing lists. You can launch a spider runnin…
Flake8-pyi's checks may produce false positives on stubs that aim to support Python 2. MIT
Subscribe to our newsletter