Hive Libraries

16 Components & Libraries

Sortby

Hive Libraries

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Linkis builds a layer of computation middleware between upper applications and underlying engines. By using standard interfaces such as REST/WS/JDBC provided by Linkis, the upper applications can eas…

Open Source Document Management System for Digital Archives (Scanned Documents)

Papermerge DMS or simply Papermerge is a open source document management system designed to work with scanned documents (also called digital archives). It extracts text from your scans using OCR, ind…

news-please - an integrated web crawler and information extractor for news that just works

news-please supports three main use cases, which are explained in more detail in the following. It's super easy, we promise! news-please runs on Python 3.5+. You can access the core functionality of …

Self-Hosted Bookmark And Archive Manager

Self-hosted Bookmark and Archive manager Bookmark links and edit its metadata (like title, tags, summary) via web-interface. Archive links content in HTML, PDF or full-page PNG format. Automatic arch…

Cortex: a Powerful Observable Analysis and Active Response Engine

Cortex is written in Scala. The front-end uses AngularJS with Bootstrap. Its REST API is stateless which allows it to be horizontally scalable. The provided analyzers are written in Python. Additiona…

ThePhish: an automated phishing email analysis tool

The following diagram shows how ThePhish works at high-level: This example aims to demonstrate how a user can send an email to ThePhish for it to be analyzed and how an analyst can actually analyze t…

Locally saves webpages to your hard disk with images, css, js & links as is.

PyWebCopy is a free tool for copying full or partial websites locally onto your hard-disk for offline viewing. PyWebCopy will scan the specified website and download its content onto your hard-disk. …

Automatically archive links to videos, images, and social media content from Google Sheets (and more).

Python tool to automatically archive social media posts, videos, and images from a Google Sheets, the console, and more. Uses different archivers depending on the platform, and can save content to lo…

Cortex Analyzers Repository

hivemq-mqtt-tensorflow-kafka-realtime-iot-machine-learning-training-inference

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

You want to see an IoT example at huge scale? Not just 100 or 1000 devices producing data, but a really scalable demo with millions of messages per second from tens of thousands of devices? This is t…

This repository contains my Data Analytics portfolio projects ranging from SQL, Python, Tableau, Excel, and Hadoop (HiveQL).

:speech_balloon: WA Reader is a platform to read WhatsApp conversations from email text backups in a easy-to-read UI.

Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.

Build with ply (lex & yacc in python). A lot of samples in 'tests/. As maintainer, I guarantee that any backward incompatible changes will not be done in patch or minor version. But! Pay attentio…

Simple C++ tool for embedding a ZIP file (up to ~5MB) within a tweetable and "executable" PNG image.

PNG Data Vehicle for Twitter, ZIP Edition (PDVZIP v1.3) If the embedded media type is Python, PowerShell, Shell script or a Windows/Linux executable, you can provide optional command-line arguments f…

A luigi powered analytics / warehouse stack

Luigi-Warehouse adds example workflows (i.e. replicating postgresql tables to redshift) more data sources We currently use slack or email for job status notifications which can easily be added Use th…

Python script that scrapes public and private Mailman archive pages and republishes them to local files, and generates an RSS feed of recent emails.

Why would you want to do this? Three reasons: You want to create your own HTML archive of a mailing list hosted elsewhere. You want to create a public version of a private archive. We hope you have p…

Related tags