Spark Libraries

39 Components & Libraries

Sortby

Spark Libraries

Spark 2.0 Python Machine Learning examples

This repository is part of a series on Apache Spark examples, aimed at demonstrating the implementation of Machine Learning solutions in different programming languages supported by Spark. Java is t…

SparkPost client library for Python

The official Python package for using the SparkPost API. Python 2.7 or later is required. Alternatively, you can pass the API key to the SparkPost class: For SparkPost EU and Enterprise accounts, pas…

A luigi powered analytics / warehouse stack

Luigi-Warehouse adds example workflows (i.e. replicating postgresql tables to redshift) more data sources We currently use slack or email for job status notifications which can easily be added Use th…

Pyhaystack is a module that allow python programs to connect to a haystack server project-haystack.org. Connection can be established with Niagara Platform running the nhaystack, Skyspark and Widesky. For this to work with Anaconda IPython Notebook in Windows, be sure to use "python setup.py install" using the Anaconda Command Prompt in Windows. If not, module will be installed for System path python but won't work in the environment of Anaconda IPython Notebook. You will need hszinc 1.3+ for this to work.

Browse a campus, building, floor... find VAV boxes, AHU units, etc. Then extract history data from them and get the results ready for analysis using pandas or your own database implementation. Actual…

Query-Driven Streaming Network Telemetry

Walkthrough notebooks for Deep Learning, Machine Learning, Reinforcement Learning, Spark, Statistics, Algorithms, Scala, Python

A collection of notebooks covering concepts that I've learned or taught

This repo contains commands that data engineers use in day to day work.

Spark-and-Kafka_IoT-Data-Processing-and-Analytics

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

If you need to generate 10,000 sensors data: In this project, I achieved 4 types of real-time analysis. ####(4) Total number of sensors The result shows console output of Spark Streaming which proces…

Columbia Image and Face Search tool for MEMEX

This project can be used to build a searchable index of images that can scale to millions of images. It provides a RESTful API for querying the index to find similar images in less than a second. The…

New generation opensource data stack

This repository contains Docker compose script that creates opensource data analytics stack on your local machine. Currently, the stack consists of multiple components: I plan to add more components …

Zoe: Container Analytics as a Service -- mirror of https://gitlab.eurecom.fr/zoe/main/

Zoe Analytics provides a simple way to provision any kind of data analytics applications. This repository is used for day-to-day, open source development, feel free to fork and contribute. Resources:…

Related tags