Engineering Libraries

A modern, enterprise-ready business intelligence web application. Superset is a modern data exploration and data visualization platform. Superset can replace or augment proprietary business intellige…

Learn the foundations of machine learning through intuitive explanations, clean code and visualizations. Learn how to combine machine learning with software engineering to build production-grade appl…

To install the current release: Participating discussions via the following IM groups is also welcomed. Over the past few years, NNI has received thousands of feedbacks on GitHub issues, and pull req…

With Dagster, you declare—as Python functions—the data assets that you want to build. Dagster then helps you run your functions at the right time and keep your assets up-to-date. Here is an example o…

TPOT will automate the most tedious part of machine learning by intelligently exploring thousands of possible pipelines to find the best one for your data. Once TPOT is finished searching (or you get…

People tracker on the Internet: Learn to track the world, to avoid being traced. Session recognition is one of trape most interesting attractions, since you as a researcher can know remotely what ser…

Install with pip You can install add-ons individually or all at once by running Below is an example of using Deep Feature Synthesis (DFS) to perform automated feature engineering. In this example, we…

Feast allows ML platform teams to: The list below contains the functionality that contributors are planning to develop for Feast. We welcome contribution to all items in the roadmap! Feast is a commu…

Aim is an open-source, self-hosted ML experiment tracking tool designed to handle 10,000s of training runs. Aim provides a performant and beautiful UI for exploring and comparing training runs. Addit…

Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON…

A simple YAML API to get started quickly, a powerful Python API for total flexibility. Automatically cache your pipeline’s previous results and only re-compute tasks that have changed since your last…

  Taipy is designed for data scientists and machine learning engineers to build full-stack apps.         To install Taipy stable release run:   Below is our filter function. This is a typical Python …

An open collection of methodologies to help with successful training of large language models and multi-modal models. This is a technical material suitable for LLM/VLM training engineers and operator…

Pandas

Managed deployment by the Langfuse team, generous free-tier (hobby plan), no credit card required. You may want to use another integration to get started quickly or implement a use case that we do no…

There are various mesh formats available for representing unstructured meshes. meshio can read and write all of the following and smoothly converts between them: Install with one of with any of the …

Framework to capture the dynamics of high-frequency limit order books. In this project I used machine learning methods to capture the high-frequency limit order book dynamics and simple trading strat…

Automated machine learning for production and analytics auto_ml is designed for production. Here's an example that includes serializing and loading the trained model, then getting predictions on sing…

🚀 Join our thriving community of likeminded developers and build the future together! dlt supports Python 3.8+. Load chess game data from chess.com API and save it in DuckDB: The dlt project is quick…

For more information, see: Current status: All packages were tested on Ubuntu 16.04 (x86_64). You can also install it locally: We can check restrictions on code using a SMT solver. For instance, supp…

Soda Core is a free, open-source, command-line tool that enables you to use the Soda Checks Language to turn user-defined input into aggregated SQL queries. When it runs a scan on a dataset, Soda Cor…

A comprehensive list of +180 YouTube Channels (in no particular order) for Data Science, Data Engineering, Machine Learning, Deep Learning, Artificial Intelligence, Computer Science, programming, sof…

Pipeline Consists of various modules: EMR - I used a 3 node cluster with below Instance Types: Finally, pyspark uses python2 as default setup on EMR. To change to python3, setup environment variable…

MLRun is an open MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the del…

Hamilton is a novel paradigm for specifying a flow of delayed execution in python. It works on python objects of any type and dataflows of any complexity. Core to the design of Hamilton is a clear ma…

The general purpose micro-framework for creating dataflows from python functions! Specifically, Hamilton defines a novel paradigm, that allows you to specify a flow of (delayed) execution, that forms…

ElectricEye is a multi-cloud, multi-SaaS Python CLI tool for Asset Management, Security Posture Management & Attack Surface Monitoring supporting 100s of services and evaluations to harden your C…

Codes: With you can access Gmsh's native file writer. pygmsh can optimize existing meshes, too. You can also use the command-line utility To run the pygmsh unit tests, check out this repository and …