Extractor Libraries

11 Components & Libraries

Sortby

Extractor Libraries

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

Trafilatura consistently outperforms other open-source libraries in text extraction benchmarks, showcasing its efficiency and accuracy in extracting web content. The extractor tries to strike a balan…

news-please - an integrated web crawler and information extractor for news that just works

news-please supports three main use cases, which are explained in more detail in the following. It's super easy, we promise! news-please runs on Python 3.5+. You can access the core functionality of …

A framework for creating semi-automatic web content extractors

The primary goal of Scrapple is to abstract the process of designing web content extractors. The focus is laid on what to extract, rather than how to do it. The user-specified configuration file cont…

SEO & Security Audit for Websites. Lighthouse & Security Headers crawler, Sitemap/Keywords/Images Extractor, Summarizer, etc ...

Init the project Please feel free to add any contribution. If you've been working on a script that could be integrated in this app. Please feel free to do it. Don't hesitate to open issues to ask que…

Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database

🕵️ Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.

Metadata, in the realm of cybersecurity, is more than just embedded information; it's a gateway to insightful perspectives, often unveiling crucial leads in OSINT and pentesting. Drawing inspiration …

Python programs & tools built in the Ethical Hacking with Python EBook

More Python programs will be added to this repository as the book will be constantly improved and enriched. The tools and scripts are:

Goblyn is a Python tool focused to enumeration and capture of website files metadata.

Goblyn is a tool focused to enumeration and capture of website files metadata. Goblyn will search for active directories in the website and so enumerate the files, if it find some file it will get th…

Yes it works! Email Extractor by Full Url Crawl. Extract emails and web urls from a website with full crawl or option limit of urls to crawl using terminal and python.

A free utility to extract email address by crawling a given url upto a given depth or number of urls to crawl provided by the user. Web email extractor by url crawl using command line interface. Emai…

Extracts the email from the user's description using Python & Google Custom Search Engine Api

LinkedIn Email Extractor is a Python script which provides the LinkedIn profiles whose description contains the email id in it. LEE saves the link to the profile and its information in an excel file …