Hive Libraries

19 Components & Libraries

Sortby

Hive Libraries

Python script that scrapes public and private Mailman archive pages and republishes them to local files, and generates an RSS feed of recent emails.

Why would you want to do this? Three reasons: You want to create your own HTML archive of a mailing list hosted elsewhere. You want to create a public version of a private archive. We hope you have p…

⛔️ [DEPRECATED] python wrapper for Firebase's REST API

A very simple wrapper for Firebase's REST API. Install python-firebase using pip: or with easy_install (not recommended): Then simply import firebase at the top of your python script: and then instan…

:speech_balloon: WA Reader is a platform to read WhatsApp conversations from email text backups in a easy-to-read UI.

Use yt-dlp to download video and upload to the Internet Archive with metadata.

This script strongly recommends Linux or some sort of POSIX system (such as macOS), preferably from a rented VPS and not your personal machine or phone. Reccomended system specifications: For Debian/…

news-please - an integrated web crawler and information extractor for news that just works

news-please supports three main use cases, which are explained in more detail in the following. It's super easy, we promise! news-please runs on Python 3.5+. You can access the core functionality of …

Cortex: a Powerful Observable Analysis and Active Response Engine

Cortex is written in Scala. The front-end uses AngularJS with Bootstrap. Its REST API is stateless which allows it to be horizontally scalable. The provided analyzers are written in Python. Additiona…

Cortex Analyzers Repository

A luigi powered analytics / warehouse stack

Luigi-Warehouse adds example workflows (i.e. replicating postgresql tables to redshift) more data sources We currently use slack or email for job status notifications which can easily be added Use th…

Self-Hosted Bookmark And Archive Manager

Self-hosted Bookmark and Archive manager Bookmark links and edit its metadata (like title, tags, summary) via web-interface. Archive links content in HTML, PDF or full-page PNG format. Automatic arch…

Locally saves webpages to your hard disk with images, css, js & links as is.

PyWebCopy is a free tool for copying full or partial websites locally onto your hard-disk for offline viewing. PyWebCopy will scan the specified website and download its content onto your hard-disk. …

hivemq-mqtt-tensorflow-kafka-realtime-iot-machine-learning-training-inference

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

You want to see an IoT example at huge scale? Not just 100 or 1000 devices producing data, but a really scalable demo with millions of messages per second from tens of thousands of devices? This is t…

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Linkis builds a layer of computation middleware between upper applications and underlying engines. By using standard interfaces such as REST/WS/JDBC provided by Linkis, the upper applications can eas…

Open Source Document Management System for Digital Archives (Scanned Documents)

Papermerge DMS or simply Papermerge is a open source document management system designed to work with scanned documents (also called digital archives). It extracts text from your scans using OCR, ind…

Querybook is a Big Data Querying UI, combining collocated table metadata and a simple notebook interface.

Please install Docker before trying out Querybook. Can be used to fetch schema and table information for metadata enrichment. Use one of the following to store query results. Upload query results fro…

Automatically archive links to videos, images, and social media content from Google Sheets (and more).

Python tool to automatically archive social media posts, videos, and images from a Google Sheets, the console, and more. Uses different archivers depending on the platform, and can save content to lo…

Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.

Build with ply (lex & yacc in python). A lot of samples in 'tests/. As maintainer, I guarantee that any backward incompatible changes will not be done in patch or minor version. But! Pay attentio…

This repository contains my Data Analytics portfolio projects ranging from SQL, Python, Tableau, Excel, and Hadoop (HiveQL).

ThePhish: an automated phishing email analysis tool

The following diagram shows how ThePhish works at high-level: This example aims to demonstrate how a user can send an email to ThePhish for it to be analyzed and how an analyst can actually analyze t…

Simple C++ tool for embedding a ZIP file (up to ~5MB) within a tweetable and "executable" PNG image.

PNG Data Vehicle for Twitter, ZIP Edition (PDVZIP v1.3) If the embedded media type is Python, PowerShell, Shell script or a Windows/Linux executable, you can provide optional command-line arguments f…

Related tags

steganography-library