Kafka Libraries

15 Components & Libraries

Sortby

Kafka Libraries

openreplay

:tv: OpenReplay is developer-friendly, open-source session replay.

OpenReplay is a session replay suite you can host yourself, that lets you see what users do on your web app, helping you troubleshoot issues faster. It's the only open-source alternative to products …

DevOps-Bash-tools

1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..

1000+ DevOps Shell Scripts and Advanced Bash environment. Fast, Advanced Systems Engineering, Automation, APIs, shorter CLIs, etc. Hari Sekhon Cloud & Big Data Contractor, United Kingdom (ex-Clou…

seldon-server

Machine Learning Platform and Recommendation Engine built on Kubernetes

Seldon Server is a machine learning platform that helps your data science team deploy models into production. Seldon supports models built with TensorFlow, Keras, Vowpal Wabbit, XGBoost, Gensim and a…

kafka-streams-machine-learning-examples

This project contains examples which demonstrate how to deploy analytic models to mission-critical, scalable production environments leveraging Apache Kafka and its Streams API. Models are built with Python, H2O, TensorFlow, Keras, DeepLearning4 and other technologies.

Here is some material about this topic if you want to read and listen to the theory instead of just doing hands-on: Here some more demos: The code is developed and tested on Mac and Linux operating s…

Agile_Data_Code_2

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

It was last updated to a fully running version in late October, 2021. You should refer to the Jupyter Notebooks in this repository rather than the book's source code, which is badly outdated and will…

zat

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

The ZAT Python package supports the processing and analysis of Zeek data with Pandas, scikit-learn, Kafka, and Spark Zeek already has a flexible, powerful scripting language why should I use ZAT?

hivemq-mqtt-tensorflow-kafka-realtime-iot-machine-learning-training-inference

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

You want to see an IoT example at huge scale? Not just 100 or 1000 devices producing data, but a really scalable demo with millions of messages per second from tens of thousands of devices? This is t…

software-development-best-practices

Modest and essential collection of software engineering practices.

ksql-python

A python wrapper for the KSQL REST API.

A python wrapper for the KSQL REST API. Easily interact with the KSQL REST API using this library. Supported KSQLDB version: 0.10.1+ Supported Python version: 3.5+ Or If you have installed open sourc…

Python-DevOps

gathers Python stack for DevOps, these are usually my basic templates use for my implementations, so, feel free to use it and evolve it! Everything is Docker!

Every folders contain .yml for docker-compose. You need to install Docker-Compose first. To run, To safely close To remove all images To remove all containers

python-fake-data-producer-for-apache-kafka

The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.

Where With Set your variables first: Parameters: You can create the Apache Kafka service with And retrieve the Apache Kafka Service URI with Apache Kafka is either a registered trademark or trademark…

Spark-and-Kafka_IoT-Data-Processing-and-Analytics

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

If you need to generate 10,000 sensors data: In this project, I achieved 4 types of real-time analysis. ####(4) Total number of sensors The result shows console output of Spark Streaming which proces…

ColumbiaImageSearch

Columbia Image and Face Search tool for MEMEX

This project can be used to build a searchable index of images that can scale to millions of images. It provides a RESTful API for querying the index to find similar images in less than a second. The…

django-kafka-demo

Django app demoing a middleware that logs all requests to a Kafka broker

Django app demoing a middleware that logs all requests to a Kafka broker Made for demonstration and demo purposes, though it can be tweaked to support a production-ready system.

OpenSourceComputerVision

Open Source Computer Vision with TensorFlow, MiniFi, Apache NiFi, OpenCV, Apache Tika and Python For processing images from IoT devices like Raspberry Pis, NVidia Jetson TX1, NanoPi Duos and more which are equipped with attached cameras or external USB webcams, we use Python to interface via OpenCV and PiCamera. From there we run image processing at the edge on these IoT device using OpenCV and TensorFlow to determine attributes and image analytics. A pache MiniFi coordinates running these Python scripts and decides when and what to send from that analysis and the image to a remote Apache NiFi server for additional processing. At the Apache NiFi cluster in the cluster it routes the images to one processing path and the JSON encoded metadata to another flow. The JSON data (with it's schema referenced from a central Schema Registry) is routed and routed using Record Processing and SQL, this data in enriched and augment before conversion to AVRO to be send via Apache Kafka to SAM. Streaming Analytics Manager then does deeper processing on this stream and others including weather and twitter to determine what should be done on this data. References https://community.hortonworks.com/articles/103863/using-an-asus-tinkerboard-with-tensorflow-and-pyth.html https://community.hortonworks.com/articles/118132/minifi-capturing-converting-tensorflow-inception-t.html https://github.com/tspannhw/rpi-noir-screen https://community.hortonworks.com/articles/77988/ingest-remote-camera-images-from-raspberry-pi-via.html https://community.hortonworks.com/articles/107379/minifi-for-image-capture-and-ingestion-from-raspbe.html https://community.hortonworks.com/articles/58265/analyzing-images-in-hdf-20-using-tensorflow.html

Open Source Computer Vision with TensorFlow, MiniFi, Apache NiFi, OpenCV, Apache Tika and Python For processing images from IoT devices like Raspberry Pis, NVidia Jetson TX1, NanoPi Duos and more w…

1

Related tags

torrent-downloader

bilinear-pooling

threat-modeling