Hand-picked awesome Python libraries and frameworks, with an emphasis on data and machine learning, organised by category 🐍

Interactive version: www.awesomepython.org

Updated 27 Feb 2024

• Code quality - Code quality tooling: linters, formatters, pre-commit hooks, unused code removal (11 repos)
• Crypto and Blockchain - Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity (12 repos)
• Data - General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks (93 repos)
• Debugging - Debugging and tracing tools (9 repos)
• Diffusion Text to Image - Text-to-image diffusion model libraries, tools and apps for generating images from natural language (35 repos)
• Finance - Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives (31 repos)
• Game Development - Game development tools, engines and libraries (6 repos)
• GIS - Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections (27 repos)
• Graph - Graphs and network libraries: network analysis, graph machine learning, visualisation (4 repos)
• GUI - Graphical user interface libraries and toolkits (8 repos)
• Jupyter - Jupyter and JupyterLab and Notebook tools, libraries and plugins (24 repos)
• LLMs and ChatGPT - Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover (202 repos)
• Math and Science - Maths and science libraries (14 repos)
• Machine Learning - General - General and classical machine learning libraries. See below for other sections covering specialised ML areas (150 repos)
• Machine Learning - Deep Learning - Machine learning libraries that cross over with deep learning in some way (69 repos)
• Machine Learning - Interpretability - Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training (13 repos)
• Machine Learning - Ops - MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models (40 repos)
• Machine Learning - Reinforcement - Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF (21 repos)
• Machine Learning - Time Series - Machine learning and classical timeseries libraries: forecasting, seasonality, anomaly detection, econometrics (17 repos)
• Natural Language Processing - Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover (80 repos)
• Packaging - Python packaging, dependency management and bundling (25 repos)
• Pandas - Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations (23 repos)
• Performance - Performance, parallelisation and low level libraries (28 repos)
• Profiling - Memory and CPU/GPU profiling tools and libraries (11 repos)
• Security - Security related libraries: vulnerability discovery, SQL injection, environment auditing (12 repos)
• Simulation - Simulation libraries: robotics, economic, agent-based, traffic, physics, astronomy, chemistry, quantum simulation. Also see the Maths and Science category for crossover (25 repos)
• Study - Miscellaneous study resources: algorithms, general resources, system design, code repos for textbooks, best practices, tutorials (51 repos)
• Template - Template tools and libraries: cookiecutter repos, generators, quick-starts (8 repos)
• Terminal - Terminal and console tools and libraries: CLI tools, terminal based formatters, progress bars (14 repos)
• Testing - Testing libraries: unit testing, load testing, acceptance testing, code coverage, browser automation, plugins (21 repos)
• Typing - Typing libraries: static and run-time type checking, annotations (10 repos)
• Utility - General utility libraries: miscellaneous tools, linters, code formatters, version management, package tools, documentation tools, (178 repos)
• Vizualisation - Vizualisation tools and libraries. Application frameworks, 2D/3D plotting, dashboards, WebGL (30 repos)
• Web - Web related frameworks and libraries: webapp servers, WSGI, ASGI, asyncio, HTTP, REST, user management (52 repos)

Code quality tooling: linters, formatters, pre-commit hooks, unused code removal.

1. psf/black
   The uncompromising Python code formatter
   🔗 black.readthedocs.io/en/stable
   ⭐ 36,772

2. astral-sh/ruff
   An extremely fast Python linter and code formatter, written in Rust.
   🔗 docs.astral.sh/ruff
   ⭐ 23,779

3. google/yapf
   A formatter for Python files
   ⭐ 13,587

4. pre-commit/pre-commit
   A framework for managing and maintaining multi-language pre-commit hooks.
   🔗 pre-commit.com
   ⭐ 11,660

5. pycqa/isort
   A Python utility / library to sort imports.
   🔗 pycqa.github.io/isort
   ⭐ 6,239

6. pycqa/pylint
   It's not just a linter that annoys you!
   🔗 pylint.readthedocs.io/en/latest
   ⭐ 5,037

7. asottile/pyupgrade
   A tool (and pre-commit hook) to automatically upgrade syntax for newer versions of the language.
   ⭐ 3,216

8. pycqa/flake8
   flake8 is a python tool that glues together pycodestyle, pyflakes, mccabe, and third-party plugins to check the style and quality of some python code.
   🔗 flake8.pycqa.org
   ⭐ 3,186

9. jendrikseipp/vulture
   Find dead Python code
   ⭐ 2,918

10. sourcery-ai/sourcery
    Instant AI code reviews to speed up your pull requests
    🔗 sourcery.ai
    ⭐ 1,466

11. akaihola/darker
    Apply black reformatting to Python files only in regions changed since a given commit. For a practical usage example, see the blog post at https://dev.to/akaihola/improving-python-code-incrementally-3f7a
    🔗 pypi.org/project/darker
    ⭐ 602

Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity.

1. ccxt/ccxt
   A JavaScript / TypeScript / Python / C# / PHP cryptocurrency trading API with support for more than 100 bitcoin/altcoin exchanges
   🔗 docs.ccxt.com
   ⭐ 30,501

2. freqtrade/freqtrade
   Free, open source crypto trading bot
   🔗 www.freqtrade.io
   ⭐ 24,429

3. crytic/slither
   Static Analyzer for Solidity and Vyper
   🔗 blog.trailofbits.com/2018/10/19/slither-a-solidity-static-analysis-framework
   ⭐ 4,864

4. ethereum/web3.py
   A python interface for interacting with the Ethereum blockchain and ecosystem.
   🔗 web3py.readthedocs.io
   ⭐ 4,643

5. ethereum/consensus-specs
   Ethereum Proof-of-Stake Consensus Specifications
   ⭐ 3,353

6. cyberpunkmetalhead/Binance-volatility-trading-bot
   This is a fully functioning Binance trading bot that measures the volatility of every coin on Binance and places trades with the highest gaining coins If you like this project consider donating though the Brave browser to allow me to continuously improve the script.
   ⭐ 3,314

7. ethereum/py-evm
   A Python implementation of the Ethereum Virtual Machine
   🔗 py-evm.readthedocs.io/en/latest
   ⭐ 2,152

8. bmoscon/cryptofeed
   Cryptocurrency Exchange Websocket Data Feed Handler
   ⭐ 2,007

9. binance/binance-public-data
   Details on how to get Binance public data
   ⭐ 1,258

10. ofek/bit
    Bitcoin made easy.
    🔗 ofek.dev/bit
    ⭐ 1,186

11. man-c/pycoingecko
    Python wrapper for the CoinGecko API
    ⭐ 1,025

12. palkeo/panoramix
    Ethereum decompiler
    ⭐ 730

General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks.

1. scrapy/scrapy
   Scrapy, a fast high-level web crawling & scraping framework for Python.
   🔗 scrapy.org
   ⭐ 50,175

2. apache/spark
   Apache Spark - A unified analytics engine for large-scale data processing
   🔗 spark.apache.org
   ⭐ 37,846

3. getredash/redash
   Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
   🔗 redash.io
   ⭐ 24,621

4. jaidedai/EasyOCR
   Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
   🔗 www.jaided.ai
   ⭐ 21,132

5. mindsdb/mindsdb
   The middleware for building custom AI, enabling smarter organizations.
   🔗 mindsdb.com
   ⭐ 19,974

6. joke2k/faker
   Faker is a Python package that generates fake data for you.
   🔗 faker.readthedocs.io
   ⭐ 16,867

7. qdrant/qdrant
   Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
   🔗 qdrant.tech
   ⭐ 16,241

8. binux/pyspider
   A Powerful Spider(Web Crawler) System in Python.
   🔗 docs.pyspider.org
   ⭐ 16,219

9. twintproject/twint
   An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
   ⭐ 15,432

10. airbytehq/airbyte
    The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
    🔗 airbyte.com
    ⭐ 13,225

11. apache/arrow
    Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
    🔗 arrow.apache.org
    ⭐ 13,165

12. tiangolo/sqlmodel
    SQL databases in Python, designed for simplicity, compatibility, and robustness.
    🔗 sqlmodel.tiangolo.com
    ⭐ 12,311

13. redis/redis-py
    Redis Python Client
    ⭐ 12,087

14. chroma-core/chroma
    the AI-native open-source embedding database
    🔗 www.trychroma.com
    ⭐ 11,059

15. coleifer/peewee
    a small, expressive orm -- supports postgresql, mysql, sqlite and cockroachdb
    🔗 docs.peewee-orm.com
    ⭐ 10,660

16. s0md3v/Photon
    Incredibly fast crawler designed for OSINT.
    ⭐ 10,367

17. simonw/datasette
    An open source multi-tool for exploring and publishing data
    🔗 datasette.io
    ⭐ 8,715

18. sqlalchemy/sqlalchemy
    The Database Toolkit for Python
    🔗 www.sqlalchemy.org
    ⭐ 8,430

19. bigscience-workshop/petals
    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
    🔗 petals.dev
    ⭐ 8,404

20. yzhao062/pyod
    A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)
    🔗 pyod.readthedocs.io
    ⭐ 7,807

21. sqlfluff/sqlfluff
    A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
    🔗 www.sqlfluff.com
    ⭐ 7,033

22. gristlabs/grist-core
    Grist is the evolution of spreadsheets.
    🔗 www.getgrist.com
    ⭐ 5,965

23. alirezamika/autoscraper
    A Smart, Automatic, Fast and Lightweight Web Scraper for Python
    ⭐ 5,807

24. kaggle/kaggle-api
    Official Kaggle API
    ⭐ 5,785

25. vi3k6i5/flashtext
    Extract Keywords from sentence or Replace keywords in sentences.
    ⭐ 5,512

26. avaiga/taipy
    Turns Data and AI algorithms into production-ready web applications in no time.
    🔗 www.taipy.io
    ⭐ 5,491

27. airbnb/knowledge-repo
    A next-generation curated knowledge sharing platform for data scientists and other technical professions.
    ⭐ 5,414

28. madmaze/pytesseract
    A Python wrapper for Google Tesseract
    ⭐ 5,365

29. tobymao/sqlglot
    Python SQL Parser and Transpiler
    🔗 sqlglot.com
    ⭐ 4,907

30. facebookresearch/AugLy
    A data augmentations library for audio, image, text, and video.
    🔗 ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models
    ⭐ 4,873

31. jazzband/tablib
    Python Module for Tabular Datasets in XLS, CSV, JSON, YAML, &c.
    🔗 tablib.readthedocs.io
    ⭐ 4,482

32. lk-geimfari/mimesis
    Mimesis is a powerful Python library that empowers developers to generate massive amounts of synthetic data efficiently.
    🔗 mimesis.name
    ⭐ 4,220

33. amundsen-io/amundsen
    Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
    🔗 www.amundsen.io/amundsen
    ⭐ 4,206

34. superduperdb/superduperdb
    🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
    🔗 superduperdb.com
    ⭐ 4,136

35. mongodb/mongo-python-driver
    PyMongo - the Official MongoDB Python driver
    🔗 pymongo.readthedocs.io
    ⭐ 4,009

36. ibis-project/ibis
    Ibis is a Python library that provides a lightweight, universal interface for data wrangling. It helps Python users explore and transform data of any size, stored anywhere.
    🔗 ibis-project.org
    ⭐ 3,682

37. andialbrecht/sqlparse
    A non-validating SQL parser module for Python
    ⭐ 3,527

38. jmcnamara/XlsxWriter
    A Python module for creating Excel XLSX files.
    🔗 xlsxwriter.readthedocs.io
    ⭐ 3,428

39. run-llama/llama-hub
    A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
    🔗 llamahub.ai
    ⭐ 3,337

40. praw-dev/praw
    PRAW, an acronym for "Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
    🔗 praw.readthedocs.io
    ⭐ 3,265

41. deepchecks/deepchecks
    Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
    🔗 docs.deepchecks.com/stable
    ⭐ 3,244

42. pyeve/cerberus
    Lightweight, extensible data validation library for Python
    🔗 python-cerberus.org
    ⭐ 3,085

43. rom1504/img2dataset
    Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
    ⭐ 3,048

44. pallets/itsdangerous
    Safely pass trusted data to untrusted environments and back.
    🔗 itsdangerous.palletsprojects.com
    ⭐ 2,803

45. zoomeranalytics/xlwings
    xlwings is a Python library that makes it easy to call Python from Excel and vice versa. It works with Excel on Windows and macOS as well as with Google Sheets and Excel on the web.
    🔗 www.xlwings.org
    ⭐ 2,792

46. goldsmith/Wikipedia
    A Pythonic wrapper for the Wikipedia API
    🔗 wikipedia.readthedocs.org
    ⭐ 2,790

47. datafold/data-diff
    Compare tables within or across databases
    🔗 docs.datafold.com
    ⭐ 2,749

48. awslabs/amazon-redshift-utils
    Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment
    ⭐ 2,690

49. docarray/docarray
    Represent, send, store and search multimodal data
    🔗 docs.docarray.org
    ⭐ 2,662

50. giskard-ai/giskard
    🐢 The testing framework for ML models, from tabular to LLMs
    🔗 docs.giskard.ai
    ⭐ 2,560

51. pynamodb/PynamoDB
    A pythonic interface to Amazon's DynamoDB
    🔗 pynamodb.readthedocs.io
    ⭐ 2,348

52. sqlalchemy/alembic
    A database migrations tool for SQLAlchemy.
    ⭐ 2,345

53. kayak/pypika
    PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.
    🔗 pypika.readthedocs.io/en/latest
    ⭐ 2,313

54. lancedb/lancedb
    Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
    🔗 lancedb.github.io/lancedb
    ⭐ 2,262

55. uqfoundation/dill
    serialize all of Python
    🔗 dill.rtfd.io
    ⭐ 2,087

56. accenture/AmpliGraph
    Python library for Representation Learning on Knowledge Graphs https://docs.ampligraph.org
    ⭐ 2,057

57. graphistry/pygraphistry
    PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer
    ⭐ 2,007

58. sdv-dev/SDV
    Synthetic data generation for tabular data
    🔗 docs.sdv.dev/sdv
    ⭐ 1,815

59. samuelcolvin/arq
    Fast job queuing and RPC in python with asyncio and redis.
    🔗 arq-docs.helpmanual.io
    ⭐ 1,797

60. uber/petastorm
    Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
    ⭐ 1,724

61. rapidai/RapidOCR
    A cross platform OCR Library based on PaddleOCR & OnnxRuntime & OpenVINO.
    🔗 rapidai.github.io/rapidocrdocs/docs
    ⭐ 1,716

62. sfu-db/connector-x
    Fastest library to load data from DB to DataFrames in Rust and Python
    🔗 sfu-db.github.io/connector-x/intro.html
    ⭐ 1,695

63. aio-libs/aiomysql
    aiomysql is a library for accessing a MySQL database from the asyncio
    🔗 aiomysql.rtfd.io
    ⭐ 1,682

64. agronholm/sqlacodegen
    Automatic model code generator for SQLAlchemy
    ⭐ 1,646

65. simple-salesforce/simple-salesforce
    A very simple Salesforce.com REST API client for Python
    ⭐ 1,558

66. milvus-io/bootcamp
    Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
    🔗 milvus.io
    ⭐ 1,548

67. collerek/ormar
    python async orm with fastapi in mind and pydantic validation
    🔗 collerek.github.io/ormar
    ⭐ 1,529

68. aminalaee/sqladmin
    SQLAlchemy Admin for FastAPI and Starlette
    🔗 aminalaee.dev/sqladmin
    ⭐ 1,455

69. sdispater/orator
    The Orator ORM provides a simple yet beautiful ActiveRecord implementation.
    🔗 orator-orm.com
    ⭐ 1,421

70. simonw/sqlite-utils
    Python CLI utility and library for manipulating SQLite databases
    🔗 sqlite-utils.datasette.io
    ⭐ 1,415

71. mchong6/JoJoGAN
    Official PyTorch repo for JoJoGAN: One Shot Face Stylization
    ⭐ 1,399

72. pathwaycom/pathway
    Pathway is a high-throughput, low-latency data processing framework that handles live data & streaming for you. Made with ❤️ for Python & ML/AI developers.
    🔗 pathway.com
    ⭐ 1,363

73. aio-libs/aiopg
    aiopg is a library for accessing a PostgreSQL database from the asyncio
    🔗 aiopg.readthedocs.io
    ⭐ 1,360

74. eleutherai/the-pile
    The Pile is a large, diverse, open source language modelling data set that consists of many smaller datasets combined together.
    ⭐ 1,356

75. dlt-hub/dlt
    data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
    🔗 dlthub.com/docs
    ⭐ 1,317

76. zarr-developers/zarr-python
    An implementation of chunked, compressed, N-dimensional arrays for Python.
    🔗 zarr.readthedocs.io
    ⭐ 1,298

77. google/tensorstore
    Library for reading and writing large multi-dimensional arrays.
    🔗 google.github.io/tensorstore
    ⭐ 1,257

78. ydataai/ydata-synthetic
    Synthetic data generators for tabular and time-series data
    🔗 docs.synthetic.ydata.ai
    ⭐ 1,223

79. pytorch/data
    A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.
    ⭐ 1,053

80. uber/fiber
    Distributed Computing for AI Made Simple
    🔗 uber.github.io/fiber
    ⭐ 1,041

81. brettkromkamp/contextualise
    Contextualise is an effective tool particularly suited for organising information-heavy projects and activities consisting of unstructured and widely diverse data and information resources
    🔗 contextualise.dev
    ⭐ 1,026

82. eliasdabbas/advertools
    advertools - online marketing productivity and analysis tools
    🔗 advertools.readthedocs.io
    ⭐ 999

83. aio-libs/aiocache
    Asyncio cache manager for redis, memcached and memory
    🔗 aiocache.readthedocs.io
    ⭐ 993

84. intake/intake
    Intake is a lightweight package for finding, investigating, loading and disseminating data.
    🔗 intake.readthedocs.io
    ⭐ 971

85. huggingface/datatrove
    Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
    ⭐ 966

86. scikit-hep/awkward
    Manipulate JSON-like data with NumPy-like idioms.
    🔗 awkward-array.org
    ⭐ 773

87. koaning/human-learn
    Natural Intelligence is still a pretty good idea.
    🔗 koaning.github.io/human-learn
    ⭐ 768

88. hyperqueryhq/whale
    🐳 The stupidly simple CLI workspace for your data warehouse.
    🔗 rsyi.gitbook.io/whale
    ⭐ 725

89. googleapis/python-bigquery
    Python Client for Google BigQuery
    ⭐ 695

90. duckdb/dbt-duckdb
    dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)
    ⭐ 673

91. mcfunley/pugsql
    A HugSQL-inspired database library for Python
    🔗 pugsql.org
    ⭐ 656

92. goccy/bigquery-emulator
    BigQuery emulator provides a way to launch a BigQuery server on your local machine for testing and development.
    ⭐ 650

93. dgarnitz/vectorflow
    VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
    🔗 www.getvectorflow.com
    ⭐ 611

Debugging and tracing tools.

1. cool-rr/PySnooper
   Never use print for debugging again
   ⭐ 16,181

2. gruns/icecream
   🍦 Never use print() to debug again.
   ⭐ 8,207

3. shobrook/rebound
   Command-line tool that instantly fetches Stack Overflow results when an exception is thrown
   ⭐ 4,057

4. inducer/pudb
   Full-screen console debugger for Python
   🔗 documen.tician.de/pudb
   ⭐ 2,830

5. gotcha/ipdb
   Integration of IPython pdb
   ⭐ 1,796

6. alexmojaki/heartrate
   Simple real time visualisation of the execution of a Python program.
   ⭐ 1,708

7. alexmojaki/birdseye
   Graphical Python debugger which lets you easily view the values of all evaluated expressions
   🔗 birdseye.readthedocs.io
   ⭐ 1,621

8. alexmojaki/snoop
   A powerful set of Python debugging tools, based on PySnooper
   ⭐ 1,167

9. samuelcolvin/python-devtools
   Dev tools for python
   🔗 python-devtools.helpmanual.io
   ⭐ 917

Text-to-image diffusion model libraries, tools and apps for generating images from natural language.

1. automatic1111/stable-diffusion-webui
   Stable Diffusion web UI
   ⭐ 121,808

2. compvis/stable-diffusion
   A latent text-to-image diffusion model
   🔗 ommer-lab.com/research/latent-diffusion-models
   ⭐ 63,611

3. stability-ai/stablediffusion
   High-Resolution Image Synthesis with Latent Diffusion Models
   ⭐ 34,541

4. lllyasviel/ControlNet
   Let us control diffusion models!
   ⭐ 26,648

5. comfyanonymous/ComfyUI
   The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.
   ⭐ 25,860

6. huggingface/diffusers
   🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
   🔗 huggingface.co/docs/diffusers
   ⭐ 21,047

7. invoke-ai/InvokeAI
   InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multi...
   🔗 invoke-ai.github.io/invokeai
   ⭐ 20,664

8. apple/ml-stable-diffusion
   Stable Diffusion with Core ML on Apple Silicon
   ⭐ 15,790

9. borisdayma/dalle-mini
   DALL·E Mini - Generate images from a text prompt
   🔗 www.craiyon.com
   ⭐ 14,529

10. divamgupta/diffusionbee-stable-diffusion-ui
    Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed.
    🔗 diffusionbee.com
    ⭐ 11,637

11. lucidrains/DALLE2-pytorch
    Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
    ⭐ 10,643

12. compvis/latent-diffusion
    High-Resolution Image Synthesis with Latent Diffusion Models
    ⭐ 9,893

13. instantid/InstantID
    InstantID : Zero-shot Identity-Preserving Generation in Seconds 🔥
    🔗 instantid.github.io
    ⭐ 7,927

14. ashawkey/stable-dreamfusion
    Text-to-3D & Image-to-3D & Mesh Exportation with NeRF + Diffusion.
    ⭐ 7,562

15. carson-katri/dream-textures
    Stable Diffusion built-in to Blender
    ⭐ 7,468

16. xavierxiao/Dreambooth-Stable-Diffusion
    Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion
    ⭐ 7,353

17. facebookresearch/dinov2
    PyTorch code and models for the DINOv2 self-supervised learning method.
    ⭐ 7,321

18. openai/consistency_models
    Official repo for consistency models.
    ⭐ 5,819

19. timothybrooks/instruct-pix2pix
    PyTorch implementation of InstructPix2Pix, an instruction-based image editing model, based on the original CompVis/stable_diffusion repo.
    ⭐ 5,743

20. idea-research/GroundingDINO
    Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
    🔗 arxiv.org/abs/2303.05499
    ⭐ 4,339

21. nateraw/stable-diffusion-videos
    Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
    ⭐ 4,016

22. salesforce/BLIP
    PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
    ⭐ 3,991

23. jina-ai/discoart
    🪩 Create Disco Diffusion artworks in one line
    ⭐ 3,837

24. lkwq007/stablediffusion-infinity
    Outpainting with Stable Diffusion on an infinite canvas
    ⭐ 3,755

25. openai/glide-text2im
    GLIDE: a diffusion-based text-conditional image synthesis model
    ⭐ 3,415

26. mlc-ai/web-stable-diffusion
    Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
    🔗 mlc.ai/web-stable-diffusion
    ⭐ 3,329

27. saharmor/dalle-playground
    A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)
    ⭐ 2,755

28. openai/improved-diffusion
    Release for Improved Denoising Diffusion Probabilistic Models
    ⭐ 2,579

29. stability-ai/stability-sdk
    SDK for interacting with stability.ai APIs (e.g. stable diffusion inference)
    🔗 platform.stability.ai
    ⭐ 2,387

30. divamgupta/stable-diffusion-tensorflow
    Stable Diffusion in TensorFlow / Keras
    ⭐ 1,556

31. coyote-a/ultimate-upscale-for-automatic1111
    Ultimate SD Upscale extension for AUTOMATIC1111 Stable Diffusion web UI
    ⭐ 1,392

32. nvlabs/prismer
    The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
    🔗 shikun.io/projects/prismer
    ⭐ 1,249

33. chenyangqiqi/FateZero
    [ICCV 2023 Oral] "FateZero: Fusing Attentions for Zero-shot Text-based Video Editing"
    🔗 fate-zero-edit.github.io
    ⭐ 1,002

34. thereforegames/unprompted
    Templating language written for Stable Diffusion workflows. Available as an extension for the Automatic1111 WebUI.
    ⭐ 725

35. sharonzhou/long_stable_diffusion
    Long-form text-to-images generation, using a pipeline of deep generative models (GPT-3 and Stable Diffusion)
    ⭐ 672

Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives.

1. openbb-finance/OpenBBTerminal
   Investment Research for Everyone, Everywhere.
   🔗 my.openbb.co/app/terminal
   ⭐ 25,618

2. quantopian/zipline
   Zipline, a Pythonic Algorithmic Trading Library
   🔗 www.zipline.io
   ⭐ 16,901

3. microsoft/qlib
   Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, ...
   🔗 qlib.readthedocs.io/en/latest
   ⭐ 13,455

4. mementum/backtrader
   Python Backtesting library for trading strategies
   🔗 www.backtrader.com
   ⭐ 12,555

5. ranaroussi/yfinance
   Download market data from Yahoo! Finance's API
   🔗 aroussi.com/post/python-yahoo-finance
   ⭐ 11,315

6. ai4finance-foundation/FinGPT
   Data-Centric FinGPT. Open-source for open finance! Revolutionize 🔥 We release the trained model on HuggingFace.
   🔗 discord.gg/trsr8sxpw5
   ⭐ 10,681

7. ai4finance-foundation/FinRL
   FinRL: Financial Reinforcement Learning. 🔥
   🔗 discord.gg/trsr8sxpw5
   ⭐ 8,786

8. ta-lib/ta-lib-python
   Python wrapper for TA-Lib (http://ta-lib.org/).
   🔗 ta-lib.github.io/ta-lib-python
   ⭐ 8,763

9. quantconnect/Lean
   Lean Algorithmic Trading Engine by QuantConnect (Python, C#)
   🔗 lean.io
   ⭐ 8,453

10. quantopian/pyfolio
    Portfolio and risk analytics in Python
    🔗 quantopian.github.io/pyfolio
    ⭐ 5,344

11. kernc/backtesting.py
    🔎 📈 🐍 💰 Backtest trading strategies in Python.
    🔗 kernc.github.io/backtesting.py
    ⭐ 4,588

12. twopirllc/pandas-ta
    Technical Analysis Indicators - Pandas TA is an easy to use Python 3 Pandas Extension with 130+ Indicators
    🔗 twopirllc.github.io/pandas-ta
    ⭐ 4,511

13. gbeced/pyalgotrade
    Python Algorithmic Trading Library
    🔗 gbeced.github.io/pyalgotrade
    ⭐ 4,255

14. google/tf-quant-finance
    High-performance TensorFlow library for quantitative finance.
    ⭐ 4,198

15. ranaroussi/quantstats
    Portfolio analytics for quants, written in Python
    ⭐ 4,004

16. borisbanushev/stockpredictionai
    In this noteboook I will create a complete process for predicting stock price movements. Follow along and we will achieve some pretty good results. For that purpose we will use a Generative Adversarial Network (GAN) with LSTM, a type of Recurrent Neural Network, as generator, and a Convolutional Neural Networ...
    ⭐ 3,891

17. polakowo/vectorbt
    Find your trading edge, using the fastest engine for backtesting, algorithmic trading, and research.
    🔗 vectorbt.dev
    ⭐ 3,573

18. cuemacro/finmarketpy
    Python library for backtesting trading strategies & analyzing financial markets (formerly pythalesians)
    🔗 www.cuemacro.com
    ⭐ 3,300

19. matplotlib/mplfinance
    Financial Markets Data Visualization using Matplotlib
    🔗 pypi.org/project/mplfinance
    ⭐ 3,224

20. quantopian/alphalens
    Performance analysis of predictive (alpha) stock factors
    🔗 quantopian.github.io/alphalens
    ⭐ 2,985

21. zvtvz/zvt
    modular quant framework.
    🔗 zvt.readthedocs.io/en/latest
    ⭐ 2,838

22. goldmansachs/gs-quant
    Python toolkit for quantitative finance
    🔗 developer.gs.com/discover/products/gs-quant
    ⭐ 2,338

23. robcarver17/pysystemtrade
    Systematic Trading in python
    ⭐ 2,306

24. quantopian/research_public
    Quantitative research and educational materials
    🔗 www.quantopian.com/lectures
    ⭐ 2,279

25. pmorissette/bt
    bt - flexible backtesting for Python
    🔗 pmorissette.github.io/bt
    ⭐ 1,930

26. blankly-finance/blankly
    🚀 💸 Easily build, backtest and deploy your algo in just a few lines of code. Trade stocks, cryptos, and forex across exchanges w/ one package.
    🔗 package.blankly.finance
    ⭐ 1,903

27. domokane/FinancePy
    A Python Finance Library that focuses on the pricing and risk-management of Financial Derivatives, including fixed-income, equity, FX and credit derivatives.
    🔗 financepy.com
    ⭐ 1,785

28. pmorissette/ffn
    ffn - a financial function library for Python
    🔗 pmorissette.github.io/ffn
    ⭐ 1,727

29. cuemacro/findatapy
    Python library to download market data via Bloomberg, Eikon, Quandl, Yahoo etc.
    ⭐ 1,530

30. quantopian/empyrical
    Common financial risk and performance metrics. Used by zipline and pyfolio.
    🔗 quantopian.github.io/empyrical
    ⭐ 1,201

31. idanya/algo-trader
    Trading bot with support for realtime trading, backtesting, custom strategies and much more.
    ⭐ 733

Game development tools, engines and libraries.

1. kitao/pyxel
   A retro game engine for Python
   ⭐ 12,957

2. pygame/pygame
   🐍🎮 pygame (the library) is a Free and Open Source python programming language library for making multimedia applications like games built on top of the excellent SDL library. C, Python, Native, OpenGL.
   🔗 www.pygame.org
   ⭐ 6,767

3. panda3d/panda3d
   Powerful, mature open-source cross-platform game engine for Python and C++, developed by Disney and CMU
   🔗 www.panda3d.org
   ⭐ 4,181

4. pokepetter/ursina
   A game engine powered by python and panda3d.
   🔗 pokepetter.github.io/ursina
   ⭐ 2,042

5. pyglet/pyglet
   pyglet is a cross-platform windowing and multimedia library for Python, for developing games and other visually rich applications.
   🔗 pyglet.org
   ⭐ 1,703

6. pythonarcade/arcade
   Easy to use Python library for creating 2D arcade games.
   🔗 arcade.academy
   ⭐ 1,593

Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections.

1. domlysz/BlenderGIS
   Blender addons to make the bridge between Blender and geographic data
   ⭐ 7,079

2. python-visualization/folium
   Python Data. Leaflet.js Maps.
   🔗 python-visualization.github.io/folium
   ⭐ 6,591

3. gboeing/osmnx
   OSMnx is a Python package to easily download, model, analyze, and visualize street networks and other geospatial features from OpenStreetMap.
   🔗 osmnx.readthedocs.io
   ⭐ 4,581

4. osgeo/gdal
   GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats.
   🔗 gdal.org
   ⭐ 4,337

5. geopandas/geopandas
   Python tools for geographic data
   🔗 geopandas.org
   ⭐ 4,066

6. shapely/shapely
   Manipulation and analysis of geometric objects
   🔗 shapely.readthedocs.io/en/stable
   ⭐ 3,592

7. holoviz/datashader
   Quickly and accurately render even the largest data.
   🔗 datashader.org
   ⭐ 3,160

8. giswqs/geemap
   A Python package for interactive geospaital analysis and visualization with Google Earth Engine.
   🔗 geemap.org
   ⭐ 3,092

9. opengeos/leafmap
   A Python package for interactive mapping and geospatial analysis with minimal coding in a Jupyter environment
   🔗 leafmap.org
   ⭐ 2,858

10. opengeos/segment-geospatial
    A Python package for segmenting geospatial data with the Segment Anything Model (SAM)
    🔗 samgeo.gishub.org
    ⭐ 2,552

11. google/earthengine-api
    Python and JavaScript bindings for calling the Earth Engine API.
    ⭐ 2,476

12. microsoft/torchgeo
    TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data
    🔗 www.osgeo.org/projects/torchgeo
    ⭐ 2,119

13. rasterio/rasterio
    Rasterio reads and writes geospatial raster datasets
    🔗 rasterio.readthedocs.io
    ⭐ 2,091

14. mcordts/cityscapesScripts
    README and scripts for the Cityscapes Dataset
    ⭐ 2,063

15. azavea/raster-vision
    An open source library and framework for deep learning on satellite and aerial imagery.
    🔗 docs.rastervision.io
    ⭐ 1,966

16. plant99/felicette
    Satellite imagery for dummies.
    ⭐ 1,814

17. apache/sedona
    A cluster computing framework for processing large-scale geospatial data
    🔗 sedona.apache.org
    ⭐ 1,725

18. jupyter-widgets/ipyleaflet
    A Jupyter - Leaflet.js bridge
    🔗 ipyleaflet.readthedocs.io
    ⭐ 1,440

19. gboeing/osmnx-examples
    Gallery of OSMnx tutorials, usage examples, and feature demonstations.
    🔗 osmnx.readthedocs.io
    ⭐ 1,411

20. microsoft/GlobalMLBuildingFootprints
    Worldwide building footprints derived from satellite imagery
    ⭐ 1,215

21. residentmario/geoplot
    High-level geospatial data visualization library for Python.
    🔗 residentmario.github.io/geoplot/index.html
    ⭐ 1,107

22. anitagraser/movingpandas
    Movement trajectory classes and functions built on top of GeoPandas
    🔗 movingpandas.org
    ⭐ 1,099

23. sentinel-hub/eo-learn
    Earth observation processing framework for machine learning in Python
    🔗 eo-learn.readthedocs.io/en/latest
    ⭐ 1,067

24. makepath/xarray-spatial
    Raster-based Spatial Analytics for Python
    🔗 xarray-spatial.org
    ⭐ 757

25. osgeo/grass
    GRASS GIS - free and open-source geospatial processing engine
    🔗 grass.osgeo.org
    ⭐ 734

26. scikit-mobility/scikit-mobility
    scikit-mobility: mobility analysis in Python
    🔗 scikit-mobility.github.io/scikit-mobility
    ⭐ 680

27. developmentseed/titiler
    Build your own Raster dynamic map tile services
    🔗 developmentseed.org/titiler
    ⭐ 655

Graphs and network libraries: network analysis, graph machine learning, visualisation.

1. networkx/networkx
   Network Analysis in Python
   🔗 networkx.org
   ⭐ 13,917

2. stellargraph/stellargraph
   StellarGraph - Machine Learning on Graphs
   🔗 stellargraph.readthedocs.io
   ⭐ 2,849

3. westhealth/pyvis
   Python package for creating and visualizing interactive network graphs.
   🔗 pyvis.readthedocs.io/en/latest
   ⭐ 878

4. rampasek/GraphGPS
   Recipe for a General, Powerful, Scalable Graph Transformer
   ⭐ 558

Graphical user interface libraries and toolkits.

1. pysimplegui/PySimpleGUI
   Python GUIs for Humans! PySimpleGUI is the top-rated Python application development environment. Launched in 2018 and actively developed, maintained, and supported in 2024. Transforms tkinter, Qt, WxPython, and Remi into a simple, intuitive, and fun experience for both hobbyists and expert users.
   🔗 www.pysimplegui.com
   ⭐ 13,024

2. hoffstadt/DearPyGui
   Dear PyGui: A fast and powerful Graphical User Interface Toolkit for Python with minimal dependencies
   🔗 dearpygui.readthedocs.io/en/latest
   ⭐ 11,900

3. parthjadhav/Tkinter-Designer
   An easy and fast way to create a Python GUI 🐍
   ⭐ 7,951

4. r0x0r/pywebview
   Build GUI for your Python program with JavaScript, HTML, and CSS
   🔗 pywebview.flowrl.com
   ⭐ 4,061

5. beeware/toga
   A Python native, OS native GUI toolkit.
   🔗 toga.readthedocs.io/en/latest
   ⭐ 4,038

6. samuelcolvin/FastUI
   FastUI is a new way to build web application user interfaces defined by declarative Python code.
   🔗 fastui-demo.onrender.com
   ⭐ 3,655

7. dddomodossola/remi
   Python REMote Interface library. Platform independent. In about 100 Kbytes, perfect for your diet.
   ⭐ 3,439

8. wxwidgets/Phoenix
   wxPython's Project Phoenix. A new implementation of wxPython, better, stronger, faster than he was before.
   🔗 wxpython.org
   ⭐ 2,143

Jupyter and JupyterLab and Notebook tools, libraries and plugins.

1. jupyterlab/jupyterlab
   JupyterLab computational environment.
   🔗 jupyterlab.readthedocs.io
   ⭐ 13,621

2. jupyter/notebook
   Jupyter Interactive Notebook
   🔗 jupyter-notebook.readthedocs.io
   ⭐ 10,959

3. mwouts/jupytext
   Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts
   🔗 jupytext.readthedocs.io
   ⭐ 6,347

4. nteract/papermill
   📚 Parameterize, execute, and analyze notebooks
   🔗 papermill.readthedocs.io/en/latest
   ⭐ 5,543

5. connorferster/handcalcs
   Python library for converting Python calculations into rendered latex.
   ⭐ 5,322

6. voila-dashboards/voila
   Voilà turns Jupyter notebooks into standalone web applications
   🔗 voila.readthedocs.io
   ⭐ 5,114

7. executablebooks/jupyter-book
   Create beautiful, publication-quality books and documents from computational content.
   🔗 jupyterbook.org
   ⭐ 3,628

8. jupyterlite/jupyterlite
   Wasm powered Jupyter running in the browser 💡
   🔗 jupyterlite.rtfd.io/en/stable/try/lab
   ⭐ 3,513

9. jupyterlab/jupyterlab-desktop
   JupyterLab desktop application, based on Electron.
   ⭐ 3,252

10. quantopian/qgrid
    An interactive grid for sorting, filtering, and editing DataFrames in Jupyter notebooks
    ⭐ 3,011

11. jupyter-widgets/ipywidgets
    Interactive Widgets for the Jupyter Notebook
    🔗 ipywidgets.readthedocs.io
    ⭐ 2,998

12. jupyterlab/jupyter-ai
    A generative AI extension for JupyterLab
    🔗 jupyter-ai.readthedocs.io
    ⭐ 2,659

13. jupyter/nbdime
    Tools for diffing and merging of Jupyter notebooks.
    🔗 nbdime.readthedocs.io
    ⭐ 2,567

14. jupyter/nbviewer
    nbconvert as a web service: Render Jupyter Notebooks as static web pages
    🔗 nbviewer.jupyter.org
    ⭐ 2,149

15. mito-ds/mito
    The mitosheet package, trymito.io, and other public Mito code.
    🔗 trymito.io
    ⭐ 2,142

16. maartenbreddels/ipyvolume
    3d plotting for Python in the Jupyter notebook based on IPython widgets using WebGL
    ⭐ 1,896

17. jupyter-lsp/jupyterlab-lsp
    Coding assistance for JupyterLab (code navigation + hover suggestions + linters + autocompletion + rename) using Language Server Protocol
    ⭐ 1,683

18. jupyter/nbconvert
    Jupyter Notebook Conversion
    🔗 nbconvert.readthedocs.io
    ⭐ 1,633

19. jupyter/nbgrader
    A system for assigning and grading notebooks
    🔗 nbgrader.readthedocs.io
    ⭐ 1,246

20. nbqa-dev/nbQA
    Run ruff, isort, pyupgrade, mypy, pylint, flake8, and more on Jupyter Notebooks
    🔗 nbqa.readthedocs.io/en/latest/index.html
    ⭐ 940

21. vizzuhq/ipyvizzu
    Build animated charts in Jupyter Notebook and similar environments with a simple Python syntax.
    🔗 ipyvizzu.vizzuhq.com
    ⭐ 908

22. aws/graph-notebook
    Library extending Jupyter notebooks to integrate with Apache TinkerPop, openCypher, and RDF SPARQL.
    🔗 github.com/aws/graph-notebook
    ⭐ 666

23. linealabs/lineapy
    Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.
    🔗 lineapy.org
    ⭐ 648

24. koaning/drawdata
    Draw datasets from within Jupyter.
    🔗 calmcode.io/labs/drawdata.html
    ⭐ 644

Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover.

1. torantulino/AutoGPT
   AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
   🔗 agpt.co
   ⭐ 157,985

2. hwchase17/langchain
   🦜🔗 Build context-aware reasoning applications
   🔗 python.langchain.com
   ⭐ 76,928

3. nomic-ai/gpt4all
   gpt4all: run open-source LLMs anywhere
   🔗 gpt4all.io
   ⭐ 61,381

4. xtekky/gpt4free
   The official gpt4free repository | various collection of powerful language models
   🔗 discord.gg/xfybzpxph5
   ⭐ 53,038

5. ggerganov/llama.cpp
   Port of Facebook's LLaMA model in C/C++
   ⭐ 51,019

6. facebookresearch/llama
   Inference code for LLaMA models
   ⭐ 49,947

7. antonosika/gpt-engineer
   Specify what you want it to build, the AI asks for clarification, and then builds it.
   ⭐ 49,143

8. imartinez/privateGPT
   Interact with your documents using the power of GPT, 100% privately, no data leaks
   🔗 docs.privategpt.dev
   ⭐ 47,686

9. killianlucas/open-interpreter
   A natural language interface for computers
   🔗 openinterpreter.com
   ⭐ 40,594

10. thudm/ChatGLM-6B
    ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
    ⭐ 37,842

11. hpcaitech/ColossalAI
    Making large AI models cheaper, faster and more accessible
    🔗 www.colossalai.org
    ⭐ 36,398

12. laion-ai/Open-Assistant
    OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
    🔗 open-assistant.io
    ⭐ 36,317

13. moymix/TaskMatrix
    Connects ChatGPT and a series of Visual Foundation Models to enable sending and receiving images during chatting.
    ⭐ 34,449

14. geekan/MetaGPT
    🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo
    🔗 deepwisdom.ai
    ⭐ 34,383

15. oobabooga/text-generation-webui
    A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
    ⭐ 33,030

16. lm-sys/FastChat
    An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
    ⭐ 31,737

17. karpathy/nanoGPT
    The simplest, fastest repository for training/finetuning medium-sized GPTs.
    ⭐ 29,333

18. tatsu-lab/stanford_alpaca
    Code and documentation to train Stanford's Alpaca models, and generate the data.
    🔗 crfm.stanford.edu/2023/03/13/alpaca.html
    ⭐ 28,343

19. jerryjliu/llama_index
    LlamaIndex (formerly GPT Index) is a data framework for your LLM applications
    🔗 docs.llamaindex.ai
    ⭐ 28,269

20. vision-cair/MiniGPT-4
    Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
    🔗 minigpt-4.github.io
    ⭐ 24,502

21. microsoft/JARVIS
    JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
    ⭐ 22,682

22. microsoft/autogen
    Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ
    🔗 microsoft.github.io/autogen
    ⭐ 21,993

23. pythagora-io/gpt-pilot
    Dev tool that writes scalable apps from scratch while the developer oversees the implementation
    ⭐ 21,461

24. openai/gpt-2
    Code for the paper "Language Models are Unsupervised Multitask Learners"
    🔗 openai.com/blog/better-language-models
    ⭐ 20,639

25. openai/chatgpt-retrieval-plugin
    The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.
    ⭐ 20,588

26. yoheinakajima/babyagi
    GPT-4 powered task-driven autonomous agent
    ⭐ 18,565

27. tloen/alpaca-lora
    Instruct-tune LLaMA on consumer hardware
    ⭐ 17,895

28. karpathy/minGPT
    A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
    ⭐ 17,788

29. rasahq/rasa
    💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
    🔗 rasa.com/docs/rasa
    ⭐ 17,618

30. microsoft/semantic-kernel
    Integrate cutting-edge LLM technology quickly and easily into your apps
    🔗 aka.ms/semantic-kernel
    ⭐ 16,831

31. guidance-ai/guidance
    A guidance language for controlling large language models.
    ⭐ 16,280

32. mlc-ai/mlc-llm
    Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
    🔗 llm.mlc.ai/docs
    ⭐ 15,667

33. thudm/ChatGLM2-6B
    ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
    ⭐ 15,081

34. vllm-project/vllm
    A high-throughput and memory-efficient inference and serving engine for LLMs
    🔗 docs.vllm.ai
    ⭐ 14,894

35. logspace-ai/langflow
    ⛓️ Langflow is a dynamic graph where each node is an executable unit. Its modular and interactive design fosters rapid experimentation and prototyping, pushing hard on the limits of creativity.
    🔗 www.langflow.org
    ⭐ 14,601

36. karpathy/llama2.c
    Inference Llama 2 in one file of pure C
    ⭐ 14,299

37. mayooear/gpt4-pdf-chatbot-langchain
    GPT4 & LangChain Chatbot for large PDF docs
    🔗 www.youtube.com/watch?v=ih9pbgvvoo4
    ⭐ 14,215

38. haotian-liu/LLaVA
    [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
    🔗 llava.hliu.cc
    ⭐ 14,019

39. fauxpilot/fauxpilot
    FauxPilot - an open-source alternative to GitHub Copilot server
    ⭐ 14,000

40. transformeroptimus/SuperAGI
    <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
    🔗 superagi.com
    ⭐ 13,799

41. facebookresearch/codellama
    Inference code for CodeLlama models
    ⭐ 13,533

42. openai/evals
    Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
    ⭐ 13,283

43. deepset-ai/haystack
    🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conv...
    🔗 haystack.deepset.ai
    ⭐ 12,728

44. idea-research/Grounded-Segment-Anything
    Grounded-SAM: Marrying Grounding-DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything
    🔗 arxiv.org/abs/2401.14159
    ⭐ 12,652

45. huggingface/peft
    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
    🔗 huggingface.co/docs/peft
    ⭐ 12,588

46. hiyouga/LLaMA-Factory
    Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
    ⭐ 11,777

47. hiyouga/LLaMA-Factory
    Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
    ⭐ 11,777

48. openlmlab/MOSS
    An open-source tool-augmented conversational language model from Fudan University
    🔗 txsun1997.github.io/blogs/moss.html
    ⭐ 11,736

49. smol-ai/developer
    the first library to let you embed a developer agent in your own app!
    🔗 twitter.com/smolmodels
    ⭐ 11,501

50. blinkdl/RWKV-LM
    RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
    ⭐ 11,083

51. paddlepaddle/PaddleNLP
    👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
    🔗 paddlenlp.readthedocs.io
    ⭐ 11,003

52. databrickslabs/dolly
    Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
    🔗 www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html
    ⭐ 10,720

53. h2oai/h2ogpt
    Private Q&A and summarization of documents+images or chat with local GPT, 100% private, Apache 2.0. Supports Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
    🔗 h2o.ai
    ⭐ 9,767

54. dao-ailab/flash-attention
    Fast and memory-efficient exact attention
    ⭐ 9,586

55. blinkdl/ChatRWKV
    ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
    ⭐ 9,155

56. shishirpatil/gorilla
    Enables LLMs to use tools by invoking APIs. Given a query, Gorilla comes up with the semantically and syntactically correct API.
    🔗 gorilla.cs.berkeley.edu
    ⭐ 8,982

57. artidoro/qlora
    QLoRA: Efficient Finetuning of Quantized LLMs
    🔗 arxiv.org/abs/2305.14314
    ⭐ 8,903

58. mlc-ai/web-llm
    Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.
    🔗 mlc.ai/web-llm
    ⭐ 8,598

59. microsoft/LoRA
    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
    🔗 arxiv.org/abs/2106.09685
    ⭐ 8,224

60. eleutherai/gpt-neo
    An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
    🔗 www.eleuther.ai
    ⭐ 8,111

61. joaomdmoura/crewAI
    Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
    🔗 crewai.io
    ⭐ 7,832

62. nvidia/Megatron-LM
    Ongoing research training transformer models at scale
    ⭐ 7,813

63. embedchain/embedchain
    The Open Source RAG framework
    🔗 docs.embedchain.ai
    ⭐ 7,747

64. optimalscale/LMFlow
    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
    🔗 optimalscale.github.io/lmflow
    ⭐ 7,631

65. thudm/CodeGeeX
    CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
    🔗 codegeex.cn
    ⭐ 7,603

66. mistralai/mistral-src
    Reference implementation of Mistral AI 7B v0.1 model.
    🔗 mistral.ai
    ⭐ 7,581

67. thudm/GLM-130B
    GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
    ⭐ 7,532

68. facebookresearch/llama-recipes
    Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcas...
    ⭐ 7,504

69. apple/ml-ferret
    Ferret: Refer and Ground Anything Anywhere at Any Granularity
    ⭐ 7,396

70. lvwerra/trl
    Train transformer language models with reinforcement learning.
    🔗 hf.co/docs/trl
    ⭐ 7,392

71. microsoft/promptflow
    Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
    🔗 microsoft.github.io/promptflow
    ⭐ 7,359

72. lianjiatech/BELLE
    BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
    ⭐ 7,271

73. openlm-research/open_llama
    OpenLLaMA: An Open Reproduction of LLaMA
    ⭐ 7,084

74. assafelovic/gpt-researcher
    GPT based autonomous agent that does online comprehensive research on any given topic
    🔗 tavily.com
    ⭐ 7,042

75. huggingface/text-generation-inference
    Large Language Model Text Generation Inference
    🔗 hf.co/docs/text-generation-inference
    ⭐ 6,994

76. plachtaa/VALL-E-X
    An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io
    ⭐ 6,868

77. bigcode-project/starcoder
    Home of StarCoder: fine-tuning & inference!
    ⭐ 6,867

78. sweepai/sweep
    Sweep: AI-powered Junior Developer for small features and bug fixes.
    🔗 sweep.dev
    ⭐ 6,764

79. stanfordnlp/dspy
    DSPy: The framework for programming—not prompting—foundation models
    ⭐ 6,613

80. sjtu-ipads/PowerInfer
    High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
    ⭐ 6,564

81. bhaskatripathi/pdfGPT
    PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!
    🔗 bhaskartripathi-pdfgpt-turbo.hf.space
    ⭐ 6,533

82. eleutherai/gpt-neox
    An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
    ⭐ 6,413

83. jzhang38/TinyLlama
    The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
    ⭐ 6,126

84. zilliztech/GPTCache
    Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
    🔗 gptcache.readthedocs.io
    ⭐ 6,113

85. nat/openplayground
    An LLM playground you can run on your laptop
    ⭐ 5,990

86. mit-han-lab/streaming-llm
    [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
    🔗 arxiv.org/abs/2309.17453
    ⭐ 5,956

87. langchain-ai/opengpts
    An open source effort to create a similar experience to OpenAI's GPTs and Assistants API.
    ⭐ 5,650

88. lightning-ai/lit-llama
    Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
    ⭐ 5,612

89. abetlen/llama-cpp-python
    Python bindings for llama.cpp
    🔗 llama-cpp-python.readthedocs.io
    ⭐ 5,597

90. run-llama/rags
    Build ChatGPT over your data, all with natural language
    ⭐ 5,525

91. berriai/litellm
    Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
    🔗 docs.litellm.ai/docs
    ⭐ 5,500

92. danielmiessler/fabric
    fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
    🔗 danielmiessler.com/p/fabric-origin-story
    ⭐ 5,481

93. vaibhavs10/insanely-fast-whisper
    An opinionated CLI to transcribe Audio files w/ Whisper on-device! Powered by 🤗 Transformers, Optimum & flash-attn
    ⭐ 5,479

94. dsdanielpark/Bard-API
    The unofficial python package that returns response of Google Bard through cookie value.
    🔗 pypi.org/project/bardapi
    ⭐ 5,399

95. skypilot-org/skypilot
    SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
    🔗 skypilot.readthedocs.io
    ⭐ 5,171

96. lightning-ai/lit-gpt
    Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
    ⭐ 5,017

97. karpathy/minbpe
    Minimal, clean, code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
    ⭐ 4,995

98. minedojo/Voyager
    An Open-Ended Embodied Agent with Large Language Models
    🔗 voyager.minedojo.org
    ⭐ 4,894

99. pytorch-labs/gpt-fast
    Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
    ⭐ 4,702

100. chainlit/chainlit
     Build Conversational AI in minutes ⚡️
     🔗 docs.chainlit.io
     ⭐ 4,681

101. microsoft/promptbase
     promptbase is an evolving collection of resources, best practices, and example scripts for eliciting the best performance from foundation models.
     ⭐ 4,679

102. langchain-ai/chat-langchain
     Locally hosted chatbot specifically focused on question answering over the LangChain documentation
     🔗 chat.langchain.com
     ⭐ 4,399

103. microsoft/BioGPT
     Implementation of BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
     ⭐ 4,189

104. togethercomputer/RedPajama-Data
     The RedPajama-Data repository contains code for preparing large datasets for training large language models.
     ⭐ 4,152

105. openbmb/ToolBench
     [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
     🔗 openbmb.github.io/toolbench
     ⭐ 4,114

106. eleutherai/lm-evaluation-harness
     A framework for few-shot evaluation of language models.
     🔗 www.eleuther.ai
     ⭐ 4,028

107. kyegomez/tree-of-thoughts
     Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
     🔗 discord.gg/qutxnk2nmf
     ⭐ 3,841

108. ravenscroftj/turbopilot
     Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU
     ⭐ 3,838

109. instruction-tuning-with-gpt-4/GPT-4-LLM
     Instruction Tuning with GPT-4
     🔗 instruction-tuning-with-gpt-4.github.io
     ⭐ 3,824

110. mnotgod96/AppAgent
     AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.
     🔗 appagent-official.github.io
     ⭐ 3,756

111. 1rgs/jsonformer
     A Bulletproof Way to Generate Structured JSON from Language Models
     ⭐ 3,598

112. yizhongw/self-instruct
     Aligning pretrained language models with instruction data generated by themselves.
     ⭐ 3,560

113. mmabrouk/llm-workflow-engine
     Power CLI and Workflow manager for LLMs (core package)
     ⭐ 3,549

114. unslothai/unsloth
     5X faster 60% less memory QLoRA finetuning
     🔗 unsloth.ai
     ⭐ 3,471

115. whitead/paper-qa
     LLM Chain for answering questions from documents with citations
     ⭐ 3,471

116. luodian/Otter
     🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
     🔗 otter-ntu.github.io
     ⭐ 3,363

117. minimaxir/gpt-2-simple
     Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts
     ⭐ 3,360

118. h2oai/h2o-llmstudio
     H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
     🔗 gpt-gm.h2o.ai
     ⭐ 3,351

119. minimaxir/simpleaichat
     Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
     ⭐ 3,281

120. deep-diver/LLM-As-Chatbot
     LLM as a Chatbot Service
     ⭐ 3,193

121. eth-sri/lmql
     A language for constraint-guided and efficient LLM programming.
     🔗 lmql.ai
     ⭐ 3,061

122. nvidia/NeMo-Guardrails
     NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
     ⭐ 3,026

123. allenai/OLMo
     OLMo is a repository for training and using AI2's state-of-the-art open language models. It is built by scientists, for scientists.
     🔗 allenai.org/olmo
     ⭐ 2,996

124. microsoft/LMOps
     General technology for enabling AI capabilities w/ LLMs and MLLMs
     🔗 aka.ms/generalai
     ⭐ 2,954

125. guardrails-ai/guardrails
     Open-source Python package for specifying structure and type, validating and correcting the outputs of large language models (LLMs)
     🔗 docs.guardrailsai.com
     ⭐ 2,917

126. baichuan-inc/Baichuan-13B
     A 13B large language model developed by Baichuan Intelligent Technology
     🔗 huggingface.co/baichuan-inc/baichuan-13b-chat
     ⭐ 2,894

127. iryna-kondr/scikit-llm
     Seamlessly integrate LLMs into scikit-learn.
     🔗 beastbyte.ai
     ⭐ 2,870

128. microsoft/LLMLingua
     To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
     🔗 llmlingua.com
     ⭐ 2,858

129. microsoft/torchscale
     Foundation Architecture for (M)LLMs
     🔗 aka.ms/generalai
     ⭐ 2,825

130. freedomintelligence/LLMZoo
     ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
     ⭐ 2,808

131. mshumer/gpt-llm-trainer
     Input a description of your task, and the system will generate a dataset, parse it, and fine-tune a LLaMA 2 model for you
     ⭐ 2,800

132. juncongmoo/pyllama
     LLaMA: Open and Efficient Foundation Language Models
     ⭐ 2,760

133. next-gpt/NExT-GPT
     Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model
     🔗 next-gpt.github.io
     ⭐ 2,669

134. paperswithcode/galai
     Model API for GALACTICA
     ⭐ 2,625

135. llmware-ai/llmware
     Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.
     🔗 pypi.org/project/llmware
     ⭐ 2,598

136. li-plus/chatglm.cpp
     C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & more LLMs
     ⭐ 2,353

137. defog-ai/sqlcoder
     SoTA LLM for converting natural language questions to SQL queries
     ⭐ 2,333

138. phidatahq/phidata
     Phidata is a toolkit for building AI Assistants using function calling.
     🔗 docs.phidata.com
     ⭐ 2,312

139. cg123/mergekit
     Tools for merging pretrained large language models.
     ⭐ 2,286

140. ofa-sys/OFA
     Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
     ⭐ 2,259

141. civitai/sd_civitai_extension
     All of the Civitai models inside Automatic 1111 Stable Diffusion Web UI
     ⭐ 2,211

142. alpha-vllm/LLaMA2-Accessory
     An Open-source Toolkit for LLM Development
     🔗 llama2-accessory.readthedocs.io
     ⭐ 2,183

143. hegelai/prompttools
     Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
     🔗 prompttools.readthedocs.io
     ⭐ 2,165

144. young-geng/EasyLM
     Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
     ⭐ 2,129

145. openai/finetune-transformer-lm
     Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
     🔗 s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
     ⭐ 2,028

146. openai/image-gpt
     Archived. Code and models from the paper "Generative Pretraining from Pixels"
     ⭐ 1,990

147. open-compass/opencompass
     OpenCompass is an LLM evaluation platform, supporting a wide range of models (InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
     🔗 opencompass.org.cn
     ⭐ 1,945

148. openai/gpt-2-output-dataset
     Dataset of GPT-2 outputs for research in detection, biases, and more
     ⭐ 1,861

149. pathwaycom/llm-app
     LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,⚡in sync with your data sources.
     🔗 pathway.com/developers/showcases/llm-app-pathway
     ⭐ 1,847

150. lucidrains/toolformer-pytorch
     Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
     ⭐ 1,840

151. minimaxir/aitextgen
     A robust Python tool for text-based AI training and generation using GPT-2.
     🔗 docs.aitextgen.io
     ⭐ 1,825

152. tairov/llama2.mojo
     Inference Llama 2 in one file of pure 🔥
     🔗 www.modular.com/blog/community-spotlight-how-i-built-llama2-by-aydyn-tairov
     ⭐ 1,818

153. intel/neural-compressor
     SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
     🔗 intel.github.io/neural-compressor
     ⭐ 1,803

154. neulab/prompt2model
     prompt2model - Generate Deployable Models from Natural Language Instructions
     ⭐ 1,785

155. noahshinn/reflexion
     [NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning
     ⭐ 1,747

156. weaviate/Verba
     Retrieval Augmented Generation (RAG) chatbot powered by Weaviate
     ⭐ 1,742

157. spcl/graph-of-thoughts
     Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
     🔗 arxiv.org/pdf/2308.09687.pdf
     ⭐ 1,729

158. cheshire-cat-ai/core
     Production ready AI assistant framework
     🔗 cheshirecat.ai
     ⭐ 1,724

159. openai/gpt-discord-bot
     Example Discord bot written in Python that uses the completions API to have conversations with the text-davinci-003 model, and the moderations API to filter the messages.
     ⭐ 1,656

160. huggingface/text-embeddings-inference
     A blazing fast inference solution for text embeddings models
     🔗 huggingface.co/docs/text-embeddings-inference/quick_tour
     ⭐ 1,647

161. bclavie/RAGatouille
     Bridging the gap between state-of-the-art research and alchemical RAG pipeline practices.
     ⭐ 1,634

162. ist-daslab/gptq
     Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
     🔗 arxiv.org/abs/2210.17323
     ⭐ 1,587

163. microsoft/Megatron-DeepSpeed
     Ongoing research training transformer language models at scale, including: BERT & GPT-2
     ⭐ 1,432

164. jina-ai/thinkgpt
     Agent techniques to augment your LLM and push it beyong its limits
     ⭐ 1,432

165. epfllm/meditron
     Meditron is a suite of open-source medical Large Language Models (LLMs).
     🔗 huggingface.co/epfl-llm
     ⭐ 1,414

166. cstankonrad/long_llama
     LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.
     ⭐ 1,390

167. langchain-ai/langgraph
     LangGraph is a library for building stateful, multi-actor applications with LLMs, built on top of (and intended to be used with) LangChain.
     ⭐ 1,367

168. farizrahman4u/loopgpt
     Re-implementation of Auto-GPT as a python package, written with modularity and extensibility in mind.
     ⭐ 1,359

169. explosion/spacy-transformers
     🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
     🔗 spacy.io/usage/embeddings-transformers
     ⭐ 1,309

170. ray-project/llm-applications
     A comprehensive guide to building RAG-based LLM applications for production.
     ⭐ 1,308

171. truera/trulens
     Evaluation and Tracking for LLM Experiments
     🔗 www.trulens.org
     ⭐ 1,246

172. run-llama/llama-lab
     Llama Lab is a repo dedicated to building cutting-edge projects using LlamaIndex
     ⭐ 1,216

173. bigscience-workshop/Megatron-DeepSpeed
     Ongoing research training transformer language models at scale, including: BERT & GPT-2
     ⭐ 1,168

174. chatarena/chatarena
     ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.
     🔗 www.chatarena.org
     ⭐ 1,167

175. srush/MiniChain
     A tiny library for coding with large language models.
     🔗 srush-minichain.hf.space
     ⭐ 1,162

176. akariasai/self-rag
     This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.
     🔗 selfrag.github.io
     ⭐ 1,116

177. ibm/Dromedary
     Dromedary: towards helpful, ethical and reliable LLMs.
     ⭐ 1,055

178. nomic-ai/pygpt4all
     Official supported Python bindings for llama.cpp + gpt4all
     🔗 nomic-ai.github.io/pygpt4all
     ⭐ 1,022

179. ray-project/ray-llm
     RayLLM - LLMs on Ray
     🔗 aviary.anyscale.com
     ⭐ 1,009

180. rlancemartin/auto-evaluator
     Evaluation tool for LLM QA chains
     🔗 autoevaluator.langchain.com
     ⭐ 993

181. lupantech/chameleon-llm
     Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
     🔗 chameleon-llm.github.io
     ⭐ 985

182. ctlllll/LLM-ToolMaker
     Large Language Models as Tool Makers
     ⭐ 973

183. microsoft/Llama-2-Onnx
     A Microsoft optimized version of the Llama 2 model, available from Meta
     ⭐ 947

184. linksoul-ai/AutoAgents
     Generate different roles for GPTs to form a collaborative entity for complex tasks.
     🔗 huggingface.co/spaces/linksoul/autoagents
     ⭐ 936

185. ajndkr/lanarky
     The web framework for building LLM microservices
     🔗 lanarky.ajndkr.com
     ⭐ 917

186. predibase/lorax
     Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
     🔗 predibase.github.io/lorax
     ⭐ 902

187. keirp/automatic_prompt_engineer
     Large Language Models Are Human-Level Prompt Engineers
     ⭐ 901

188. hao-ai-lab/LookaheadDecoding
     Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
     ⭐ 865

189. explosion/spacy-llm
     🦙 Integrating LLMs into structured NLP pipelines
     🔗 spacy.io/usage/large-language-models
     ⭐ 845

190. cerebras/modelzoo
     Examples of common deep learning models that can be trained on Cerebras hardware
     ⭐ 802

191. muennighoff/sgpt
     SGPT: GPT Sentence Embeddings for Semantic Search
     🔗 arxiv.org/abs/2202.08904
     ⭐ 776

192. meetkai/functionary
     Chat language model that can interpret and execute functions/plugins
     ⭐ 765

193. oliveirabruno01/babyagi-asi
     BabyAGI: an Autonomous and Self-Improving agent, or BASI
     ⭐ 741

194. opengenerativeai/GenossGPT
     One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.
     🔗 genoss.ai
     ⭐ 710

195. agenta-ai/agenta
     The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
     🔗 www.agenta.ai
     ⭐ 705

196. salesforce/xgen
     Salesforce open-source LLMs with 8k sequence length.
     ⭐ 702

197. huggingface/nanotron
     Minimalistic large language model 3D-parallelism training
     ⭐ 579

198. hazyresearch/ama_prompting
     Ask Me Anything language model prompting
     ⭐ 524

199. squeezeailab/SqueezeLLM
     SqueezeLLM: Dense-and-Sparse Quantization
     🔗 arxiv.org/abs/2306.07629
     ⭐ 516

200. zhudotexe/kani
     kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)
     🔗 kani.readthedocs.io
     ⭐ 515

201. lupantech/ScienceQA
     Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
     ⭐ 510

202. continuum-llms/chatgpt-memory
     Allows to scale the ChatGPT API to multiple simultaneous sessions with infinite contextual and adaptive memory powered by GPT and Redis datastore.
     ⭐ 510

Maths and science libraries.

1. numpy/numpy
   The fundamental package for scientific computing with Python.
   🔗 numpy.org
   ⭐ 25,749

2. scipy/scipy
   SciPy library main repository
   🔗 scipy.org
   ⭐ 12,203

3. sympy/sympy
   A computer algebra system written in pure Python
   🔗 sympy.org
   ⭐ 11,856

4. cupy/cupy
   NumPy & SciPy for GPU
   🔗 cupy.dev
   ⭐ 7,562

5. google-deepmind/alphageometry
   Solving Olympiad Geometry without Human Demonstrations
   ⭐ 3,353

6. mckinsey/causalnex
   A Python library that helps data scientists to infer causation rather than observing correlation.
   🔗 causalnex.readthedocs.io
   ⭐ 2,100

7. pyomo/pyomo
   An object-oriented algebraic modeling language in Python for structured optimization problems.
   🔗 www.pyomo.org
   ⭐ 1,785

8. facebookresearch/theseus
   A library for differentiable nonlinear optimization
   ⭐ 1,563

9. google-research/torchsde
   Differentiable SDE solvers with GPU support and efficient sensitivity analysis.
   ⭐ 1,424

10. dynamicslab/pysindy
    A package for the sparse identification of nonlinear dynamical systems from data
    🔗 pysindy.readthedocs.io/en/latest
    ⭐ 1,214

11. geomstats/geomstats
    Computations and statistics on manifolds with geometric structures.
    🔗 geomstats.ai
    ⭐ 1,122

12. cma-es/pycma
    pycma is a Python implementation of CMA-ES and a few related numerical optimization tools.
    ⭐ 995

13. sj001/AI-Feynman
    Implementation of AI Feynman: a Physics-Inspired Method for Symbolic Regression
    ⭐ 569

14. willianfuks/tfcausalimpact
    Python Causal Impact Implementation Based on Google's R Package. Built using TensorFlow Probability.
    ⭐ 550

General and classical machine learning libraries. See below for other sections covering specialised ML areas.

1. scikit-learn/scikit-learn
   scikit-learn: machine learning in Python
   🔗 scikit-learn.org
   ⭐ 57,432

2. openai/openai-cookbook
   Examples and guides for using the OpenAI API
   🔗 cookbook.openai.com
   ⭐ 54,014

3. tencentarc/GFPGAN
   GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.
   ⭐ 34,028

4. google-research/google-research
   This repository contains code released by Google Research
   🔗 research.google
   ⭐ 32,181

5. suno-ai/bark
   🔊 Text-Prompted Generative Audio Model
   ⭐ 30,568

6. open-mmlab/mmdetection
   OpenMMLab Detection Toolbox and Benchmark
   🔗 mmdetection.readthedocs.io
   ⭐ 27,046

7. facebookresearch/faiss
   A library for efficient similarity search and clustering of dense vectors.
   🔗 faiss.ai
   ⭐ 26,893

8. google/jax
   Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
   🔗 jax.readthedocs.io
   ⭐ 26,672

9. ageron/handson-ml2
   A series of Jupyter notebooks that walk you through the fundamentals of Machine Learning and Deep Learning in Python using Scikit-Learn, Keras and TensorFlow 2.
   ⭐ 26,518

10. lutzroeder/netron
    Visualizer for neural network, deep learning and machine learning models
    🔗 netron.app
    ⭐ 25,464

11. dmlc/xgboost
    Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
    🔗 xgboost.readthedocs.io/en/stable
    ⭐ 25,319

12. google/mediapipe
    Cross-platform, customizable ML solutions for live and streaming media.
    🔗 mediapipe.dev
    ⭐ 24,835

13. harisiqbal88/PlotNeuralNet
    Latex code for making neural networks diagrams
    ⭐ 20,696

14. jina-ai/jina
    ☁️ Build multimodal AI applications with cloud-native stack
    🔗 docs.jina.ai
    ⭐ 19,687

15. onnx/onnx
    Open standard for machine learning interoperability
    🔗 onnx.ai
    ⭐ 16,425

16. microsoft/LightGBM
    A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
    🔗 lightgbm.readthedocs.io/en/latest
    ⭐ 15,865

17. tensorflow/tensor2tensor
    Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
    ⭐ 14,568

18. ddbourgin/numpy-ml
    Machine learning, in numpy
    🔗 numpy-ml.readthedocs.io
    ⭐ 14,435

19. aleju/imgaug
    Image augmentation for machine learning experiments.
    🔗 imgaug.readthedocs.io
    ⭐ 14,026

20. microsoft/nni
    An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
    🔗 nni.readthedocs.io
    ⭐ 13,593

21. ml-explore/mlx
    MLX is an array framework for machine learning on Apple silicon, brought to you by Apple machine learning research.
    ⭐ 12,650

22. jindongwang/transferlearning
    Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-迁移学习
    🔗 transferlearning.xyz
    ⭐ 12,594

23. deepmind/deepmind-research
    This repository contains implementations and illustrative code to accompany DeepMind publications
    ⭐ 12,517

24. spotify/annoy
    Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk
    ⭐ 12,464

25. microsoft/Swin-Transformer
    This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
    🔗 arxiv.org/abs/2103.14030
    ⭐ 12,461

26. microsoft/onnxruntime
    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
    🔗 onnxruntime.ai
    ⭐ 12,000

27. deepmind/alphafold
    Implementation of the inference pipeline of AlphaFold v2
    ⭐ 11,388

28. neonbjb/tortoise-tts
    A multi-voice TTS system trained with an emphasis on quality
    ⭐ 11,060

29. facebookresearch/AnimatedDrawings
    Code to accompany "A Method for Animating Children's Drawings of the Human Figure"
    ⭐ 9,984

30. twitter/the-algorithm-ml
    Source code for Twitter's Recommendation Algorithm
    🔗 blog.twitter.com/engineering/en_us/topics/open-source/2023/twitter-recommendation-algorithm
    ⭐ 9,826

31. roboflow/supervision
    We write your reusable computer vision tools. 💜
    🔗 supervision.roboflow.com
    ⭐ 9,626

32. epistasislab/tpot
    A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
    🔗 epistasislab.github.io/tpot
    ⭐ 9,419

33. statsmodels/statsmodels
    Statsmodels: statistical modeling and econometrics in Python
    🔗 www.statsmodels.org/devel
    ⭐ 9,315

34. optuna/optuna
    A hyperparameter optimization framework
    🔗 optuna.org
    ⭐ 9,296

35. ggerganov/ggml
    Tensor library for machine learning
    ⭐ 8,928

36. megvii-basedetection/YOLOX
    YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
    ⭐ 8,858

37. pycaret/pycaret
    An open-source, low-code machine learning library in Python
    🔗 www.pycaret.org
    ⭐ 8,215

38. pymc-devs/pymc
    Bayesian Modeling and Probabilistic Programming in Python
    🔗 docs.pymc.io
    ⭐ 8,030

39. cleanlab/cleanlab
    The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
    🔗 cleanlab.ai
    ⭐ 7,926

40. uberi/speech_recognition
    Speech recognition module for Python, supporting several engines and APIs, online and offline.
    🔗 pypi.python.org/pypi/speechrecognition
    ⭐ 7,890

41. wandb/wandb
    🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
    🔗 wandb.ai
    ⭐ 7,852

42. catboost/catboost
    A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
    🔗 catboost.ai
    ⭐ 7,605

43. automl/auto-sklearn
    Automated Machine Learning with scikit-learn
    🔗 automl.github.io/auto-sklearn
    ⭐ 7,331

44. open-mmlab/mmsegmentation
    OpenMMLab Semantic Segmentation Toolbox and Benchmark.
    🔗 mmsegmentation.readthedocs.io/en/latest
    ⭐ 7,073

45. facebookresearch/xformers
    Hackable and optimized Transformers building blocks, supporting a composable construction.
    🔗 facebookresearch.github.io/xformers
    ⭐ 7,058

46. hyperopt/hyperopt
    Distributed Asynchronous Hyperparameter Optimization in Python
    🔗 hyperopt.github.io/hyperopt
    ⭐ 7,006

47. featurelabs/featuretools
    An open source python library for automated feature engineering
    🔗 www.featuretools.com
    ⭐ 6,961

48. awslabs/autogluon
    AutoGluon: AutoML for Image, Text, Time Series, and Tabular Data
    🔗 auto.gluon.ai
    ⭐ 6,839

49. lmcinnes/umap
    Uniform Manifold Approximation and Projection
    ⭐ 6,786

50. hips/autograd
    Efficiently computes derivatives of numpy code.
    ⭐ 6,688

51. scikit-learn-contrib/imbalanced-learn
    A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning
    🔗 imbalanced-learn.org
    ⭐ 6,643

52. py-why/dowhy
    DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.
    🔗 www.pywhy.org/dowhy
    ⭐ 6,588

53. huggingface/accelerate
    🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
    🔗 huggingface.co/docs/accelerate
    ⭐ 6,530

54. open-mmlab/mmagic
    OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.
    🔗 mmagic.readthedocs.io/en/latest
    ⭐ 6,366

55. probml/pyprobml
    Python code for "Probabilistic Machine learning" book by Kevin Murphy
    ⭐ 6,149

56. nicolashug/Surprise
    A Python scikit for building and analyzing recommender systems
    🔗 surpriselib.com
    ⭐ 6,126

57. google/automl
    Google Brain AutoML
    ⭐ 6,111

58. cleverhans-lab/cleverhans
    An adversarial example library for constructing attacks, building defenses, and benchmarking both
    ⭐ 6,025

59. kevinmusgrave/pytorch-metric-learning
    The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.
    🔗 kevinmusgrave.github.io/pytorch-metric-learning
    ⭐ 5,658

60. open-mmlab/mmcv
    OpenMMLab Computer Vision Foundation
    🔗 mmcv.readthedocs.io/en/latest
    ⭐ 5,466

61. project-monai/MONAI
    AI Toolkit for Healthcare Imaging
    🔗 monai.io
    ⭐ 5,057

62. mdbloice/Augmentor
    Image augmentation library in Python for machine learning.
    🔗 augmentor.readthedocs.io/en/stable
    ⭐ 5,005

63. rasbt/mlxtend
    A library of extension and helper modules for Python's data analysis and machine learning libraries.
    🔗 rasbt.github.io/mlxtend
    ⭐ 4,721

64. online-ml/river
    🌊 Online machine learning in Python
    🔗 riverml.xyz
    ⭐ 4,638

65. uber/causalml
    Uplift modeling and causal inference with machine learning algorithms
    ⭐ 4,589

66. lucidrains/deep-daze
    Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
    ⭐ 4,381

67. districtdatalabs/yellowbrick
    Visual analysis and diagnostic tools to facilitate machine learning model selection.
    🔗 www.scikit-yb.org
    ⭐ 4,169

68. ml-explore/mlx-examples
    Examples in the MLX framework
    ⭐ 4,099

69. nv-tlabs/GET3D
    Generative Model of High Quality 3D Textured Shapes Learned from Images
    ⭐ 4,033

70. skvark/opencv-python
    Automated CI toolchain to produce precompiled opencv-python, opencv-python-headless, opencv-contrib-python and opencv-contrib-python-headless packages.
    🔗 pypi.org/project/opencv-python
    ⭐ 4,003

71. marqo-ai/marqo
    Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
    🔗 www.marqo.ai
    ⭐ 3,958

72. apple/coremltools
    Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.
    🔗 coremltools.readme.io
    ⭐ 3,939

73. google-deepmind/graphcast
    GraphCast: Learning skillful medium-range global weather forecasting
    ⭐ 3,930

74. sanchit-gandhi/whisper-jax
    JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.
    ⭐ 3,903

75. nmslib/hnswlib
    Header-only C++/python library for fast approximate nearest neighbors
    🔗 github.com/nmslib/hnswlib
    ⭐ 3,849

76. cmusphinx/pocketsphinx
    A small speech recognizer
    ⭐ 3,670

77. ourownstory/neural_prophet
    NeuralProphet: A simple forecasting package
    🔗 neuralprophet.com
    ⭐ 3,555

78. microsoft/FLAML
    A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
    🔗 microsoft.github.io/flaml
    ⭐ 3,549

79. py-why/EconML
    ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to brin...
    🔗 www.microsoft.com/en-us/research/project/alice
    ⭐ 3,449

80. thudm/CogVideo
    Text-to-video generation. The repo for ICLR2023 paper "CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers"
    ⭐ 3,397

81. facebookresearch/vissl
    VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
    🔗 vissl.ai
    ⭐ 3,199

82. huggingface/notebooks
    Notebooks using the Hugging Face libraries 🤗
    ⭐ 3,112

83. pytorch/glow
    Compiler for Neural Network hardware accelerators
    ⭐ 3,101

84. rucaibox/RecBole
    A unified, comprehensive and efficient recommendation library
    🔗 recbole.io
    ⭐ 3,076

85. hrnet/HRNet-Semantic-Segmentation
    The OCR approach is rephrased as Segmentation Transformer: https://arxiv.org/abs/1909.11065. This is an official implementation of semantic segmentation for HRNet. https://arxiv.org/abs/1908.07919
    ⭐ 3,018

86. yoheinakajima/instagraph
    Converts text input or URL into knowledge graph and displays
    ⭐ 3,017

87. lucidrains/musiclm-pytorch
    Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
    ⭐ 2,918

88. mljar/mljar-supervised
    Python package for AutoML on Tabular Data with Feature Engineering, Hyper-Parameters Tuning, Explanations and Automatic Documentation
    🔗 mljar.com
    ⭐ 2,887

89. huggingface/autotrain-advanced
    AutoTrain Advanced: faster and easier training and deployments of state-of-the-art machine learning models
    🔗 huggingface.co/autotrain
    ⭐ 2,798

90. zjunlp/DeepKE
    An Open Toolkit for Knowledge Graph Extraction and Construction published at EMNLP2022 System Demonstrations.
    🔗 deepke.zjukg.cn
    ⭐ 2,718

91. teamhg-memex/eli5
    A library for debugging/inspecting machine learning classifiers and explaining their predictions
    🔗 eli5.readthedocs.io
    ⭐ 2,718

92. scikit-optimize/scikit-optimize
    Sequential model-based optimization with a scipy.optimize interface
    🔗 scikit-optimize.github.io
    ⭐ 2,710

93. lightly-ai/lightly
    A python library for self-supervised learning on images.
    🔗 docs.lightly.ai/self-supervised-learning
    ⭐ 2,688

94. scikit-learn-contrib/hdbscan
    A high performance implementation of HDBSCAN clustering.
    🔗 hdbscan.readthedocs.io/en/latest
    ⭐ 2,629

95. maif/shapash
    🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models
    🔗 maif.github.io/shapash
    ⭐ 2,607

96. shankarpandala/lazypredict
    Lazy Predict help build a lot of basic models without much code and helps understand which models works better without any parameter tuning
    ⭐ 2,506

97. apple/ml-ane-transformers
    Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)
    ⭐ 2,434

98. scikit-learn-contrib/category_encoders
    A library of sklearn compatible categorical variable encoders
    🔗 contrib.scikit-learn.org/category_encoders
    ⭐ 2,345

99. google-research/t5x
    T5X is a modular, composable, research-friendly framework for high-performance, configurable, self-service training, evaluation, and inference of sequence models (starting with language) at many scales.
    ⭐ 2,338

100. freedmand/semantra
     Semantra is a multipurpose tool for semantically searching documents. Query by meaning rather than just by matching text.
     ⭐ 2,174

101. aws/sagemaker-python-sdk
     A library for training and deploying machine learning models on Amazon SageMaker
     🔗 sagemaker.readthedocs.io
     ⭐ 2,010

102. rom1504/clip-retrieval
     Easily compute clip embeddings and build a clip retrieval system with them
     🔗 rom1504.github.io/clip-retrieval
     ⭐ 1,983

103. huggingface/optimum
     🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
     🔗 huggingface.co/docs/optimum/main
     ⭐ 1,975

104. rentruewang/koila
     Prevent PyTorch's CUDA error: out of memory in just 1 line of code.
     🔗 rentruewang.github.io/koila
     ⭐ 1,809

105. contextlab/hypertools
     A Python toolbox for gaining geometric insights into high-dimensional data
     🔗 hypertools.readthedocs.io/en/latest
     ⭐ 1,794

106. linkedin/greykite
     A flexible, intuitive and fast forecasting library
     ⭐ 1,773

107. bmabey/pyLDAvis
     Python library for interactive topic model visualization. Port of the R LDAvis package.
     ⭐ 1,766

108. huggingface/evaluate
     🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
     🔗 huggingface.co/docs/evaluate
     ⭐ 1,719

109. scikit-learn-contrib/lightning
     Large-scale linear classification, regression and ranking in Python
     🔗 contrib.scikit-learn.org/lightning
     ⭐ 1,699

110. tensorflow/addons
     Useful extra functionality for TensorFlow 2.x maintained by SIG-addons
     ⭐ 1,680

111. microsoft/i-Code
     The ambition of the i-Code project is to build integrative and composable multimodal AI. The "i" stands for integrative multimodal learning.
     ⭐ 1,578

112. huggingface/huggingface_hub
     The official Python client for the Huggingface Hub.
     🔗 huggingface.co/docs/huggingface_hub
     ⭐ 1,511

113. kubeflow/katib
     Repository for hyperparameter tuning
     ⭐ 1,400

114. jina-ai/finetuner
     🎯 Task-oriented embedding tuning for BERT, CLIP, etc.
     🔗 finetuner.jina.ai
     ⭐ 1,395

115. scikit-learn-contrib/metric-learn
     Metric learning algorithms in Python
     🔗 contrib.scikit-learn.org/metric-learn
     ⭐ 1,362

116. visual-layer/fastdup
     fastdup is a powerful free tool designed to rapidly extract valuable insights from your image & video datasets. Assisting you to increase your dataset images & labels quality and reduce your data operations costs at an unparalleled scale.
     ⭐ 1,346

117. castorini/pyserini
     Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
     🔗 pyserini.io
     ⭐ 1,332

118. eric-mitchell/direct-preference-optimization
     Reference implementation for DPO (Direct Preference Optimization)
     ⭐ 1,332

119. laekov/fastmoe
     A fast MoE impl for PyTorch
     🔗 fastmoe.ai
     ⭐ 1,287

120. csinva/imodels
     Interpretable ML package 🔍 for concise, transparent, and accurate predictive modeling (sklearn-compatible).
     🔗 csinva.io/imodels
     ⭐ 1,257

121. borealisai/advertorch
     A Toolbox for Adversarial Robustness Research
     ⭐ 1,254

122. awslabs/dgl-ke
     High performance, easy-to-use, and scalable package for learning large-scale knowledge graph embeddings.
     🔗 dglke.dgl.ai/doc
     ⭐ 1,214

123. googlecloudplatform/vertex-ai-samples
     Sample code and notebooks for Vertex AI, the end-to-end machine learning platform on Google Cloud
     🔗 cloud.google.com/vertex-ai
     ⭐ 1,213

124. google/vizier
     Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.
     🔗 oss-vizier.readthedocs.io
     ⭐ 1,144

125. microsoft/Olive
     Olive is an easy-to-use hardware-aware model optimization tool that composes industry-leading techniques across model compression, optimization, and compilation.
     🔗 microsoft.github.io/olive
     ⭐ 1,116

126. koaning/scikit-lego
     Extra blocks for scikit-learn pipelines.
     🔗 koaning.github.io/scikit-lego
     ⭐ 1,108

127. spotify/voyager
     🛰️ Voyager is an approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.
     🔗 spotify.github.io/voyager
     ⭐ 1,092

128. microsoft/Semi-supervised-learning
     A Unified Semi-Supervised Learning Codebase (NeurIPS'22)
     🔗 usb.readthedocs.io
     ⭐ 1,091

129. automl/TabPFN
     Official implementation of the TabPFN paper (https://arxiv.org/abs/2207.01848) and the tabpfn package.
     🔗 priorlabs.ai
     ⭐ 1,052

130. patchy631/machine-learning
     Machine Learning Tutorials Repository
     ⭐ 977

131. google-research/deeplab2
     DeepLab2 is a TensorFlow library for deep labeling, aiming to provide a unified and state-of-the-art TensorFlow codebase for dense pixel labeling tasks.
     ⭐ 973

132. dask/dask-ml
     Scalable Machine Learning with Dask
     🔗 ml.dask.org
     ⭐ 877

133. lmcinnes/pynndescent
     A Python nearest neighbor descent for approximate nearest neighbors
     ⭐ 826

134. hazyresearch/safari
     Convolutions for Sequence Modeling
     ⭐ 817

135. davidmrau/mixture-of-experts
     PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
     ⭐ 752

136. oml-team/open-metric-learning
     OML is a PyTorch-based framework to train and validate the models producing high-quality embeddings.
     🔗 open-metric-learning.readthedocs.io/en/latest/index.html
     ⭐ 737

137. criteo/autofaiss
     Automatically create Faiss knn indices with the most optimal similarity search parameters.
     🔗 criteo.github.io/autofaiss
     ⭐ 709

138. nvidia/cuda-python
     CUDA Python Low-level Bindings
     🔗 nvidia.github.io/cuda-python
     ⭐ 704

139. facebookresearch/balance
     The balance python package offers a simple workflow and methods for dealing with biased data samples when looking to infer from them to some target population of interest.
     🔗 import-balance.org
     ⭐ 663

140. opentensor/bittensor
     Internet-scale Neural Networks
     🔗 www.bittensor.com
     ⭐ 657

141. hpcaitech/EnergonAI
     Large-scale model inference.
     ⭐ 630

142. awslabs/python-deequ
     Python API for Deequ, a library built on Spark for defining "unit tests for data", which measure data quality in large datasets
     ⭐ 625

143. qdrant/fastembed
     Fast, Accurate, Lightweight Python library to make State of the Art Embedding
     🔗 qdrant.github.io/fastembed
     ⭐ 604

144. qdrant/quaterion
     Blazing fast framework for fine-tuning similarity learning models
     🔗 quaterion.qdrant.tech
     ⭐ 603

145. nicolas-hbt/pygraft
     Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips
     🔗 pygraft.readthedocs.io/en/latest
     ⭐ 559

146. replicate/replicate-python
     Python client for Replicate
     🔗 replicate.com
     ⭐ 546

147. microsoft/Focal-Transformer
     [NeurIPS 2021 Spotlight] Official code for "Focal Self-attention for Local-Global Interactions in Vision Transformers"
     ⭐ 537

148. nevronai/MetisFL
     The first open Federated Learning framework implemented in C++ and Python.
     🔗 metisfl.org
     ⭐ 528

149. cvxgrp/pymde
     Minimum-distortion embedding with PyTorch
     🔗 pymde.org
     ⭐ 507

150. huggingface/exporters
     Export Hugging Face models to Core ML and TensorFlow Lite
     ⭐ 501

Machine learning libraries that cross over with deep learning in some way.

1. tensorflow/tensorflow
   An Open Source Machine Learning Framework for Everyone
   🔗 tensorflow.org
   ⭐ 180,771

2. pytorch/pytorch
   Tensors and Dynamic neural networks in Python with strong GPU acceleration
   🔗 pytorch.org
   ⭐ 75,531

3. keras-team/keras
   Deep Learning for humans
   🔗 keras.io
   ⭐ 60,309

4. openai/whisper
   Robust Speech Recognition via Large-Scale Weak Supervision
   ⭐ 56,198

5. deepfakes/faceswap
   Deepfakes Software For All
   🔗 www.faceswap.dev
   ⭐ 48,528

6. iperov/DeepFaceLab
   DeepFaceLab is the leading software for creating deepfakes.
   ⭐ 44,567

7. facebookresearch/segment-anything
   The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
   ⭐ 42,393

8. microsoft/DeepSpeed
   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
   🔗 www.deepspeed.ai
   ⭐ 31,420

9. rwightman/pytorch-image-models
   PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNet-V3/V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
   🔗 huggingface.co/docs/timm
   ⭐ 28,754

10. facebookresearch/detectron2
    Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
    🔗 detectron2.readthedocs.io/en/latest
    ⭐ 28,081

11. pytorchlightning/pytorch-lightning
    Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
    🔗 lightning.ai
    ⭐ 26,251

12. facebookresearch/Detectron
    FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.
    ⭐ 26,090

13. xinntao/Real-ESRGAN
    Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.
    ⭐ 25,134

14. matterport/Mask_RCNN
    Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow
    ⭐ 23,927

15. paddlepaddle/Paddle
    PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
    🔗 www.paddlepaddle.org
    ⭐ 21,365

16. openai/CLIP
    CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
    ⭐ 20,736

17. apache/mxnet
    Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
    🔗 mxnet.apache.org
    ⭐ 20,687

18. pyg-team/pytorch_geometric
    Graph Neural Network Library for PyTorch
    🔗 pyg.org
    ⭐ 19,597

19. lucidrains/vit-pytorch
    Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
    ⭐ 16,995

20. rasbt/deeplearning-models
    A collection of various deep learning architectures, models, and tips
    ⭐ 16,197

21. sanster/IOPaint
    Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase and replace(powered by stable diffusion) any thing on your pictures.
    🔗 www.iopaint.com
    ⭐ 15,878

22. danielgatis/rembg
    Rembg is a tool to remove images background
    ⭐ 13,238

23. albumentations-team/albumentations
    Fast image augmentation library and an easy-to-use wrapper around other libraries. Documentation: https://albumentations.ai/docs/ Paper about the library: https://www.mdpi.com/2078-2489/11/2/125
    🔗 albumentations.ai
    ⭐ 13,128

24. dmlc/dgl
    Python package built to ease deep learning on graph, on top of existing DL frameworks.
    🔗 dgl.ai
    ⭐ 12,770

25. facebookresearch/detr
    End-to-End Object Detection with Transformers
    ⭐ 12,497

26. nvidia/DeepLearningExamples
    State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
    ⭐ 12,254

27. kornia/kornia
    Geometric Computer Vision Library for Spatial AI
    🔗 kornia.readthedocs.io
    ⭐ 9,115

28. keras-team/autokeras
    AutoML library for deep learning
    🔗 autokeras.com
    ⭐ 9,042

29. pyro-ppl/pyro
    Deep universal probabilistic programming with Python and PyTorch
    🔗 pyro.ai
    ⭐ 8,272

30. facebookresearch/pytorch3d
    PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
    🔗 pytorch3d.org
    ⭐ 8,088

31. google/trax
    Trax — Deep Learning with Clear Code and Speed
    ⭐ 7,886

32. nvidia/apex
    A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
    ⭐ 7,862

33. arogozhnikov/einops
    Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
    🔗 einops.rocks
    ⭐ 7,674

34. facebookresearch/ImageBind
    ImageBind One Embedding Space to Bind Them All
    ⭐ 7,654

35. lucidrains/imagen-pytorch
    Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
    ⭐ 7,643

36. xpixelgroup/BasicSR
    Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc. Currently, it includes EDSR, RCAN, SRResNet, SRGAN, ESRGAN, EDVR, BasicVSR, SwinIR, ECBSR, etc. Also support StyleGAN2, DFDNet.
    🔗 basicsr.readthedocs.io/en/latest
    ⭐ 5,915

37. skorch-dev/skorch
    A scikit-learn compatible neural network library that wraps PyTorch
    ⭐ 5,569

38. facebookresearch/mmf
    A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
    🔗 mmf.sh
    ⭐ 5,377

39. google/flax
    Flax is a neural network library for JAX that is designed for flexibility.
    🔗 flax.readthedocs.io
    ⭐ 5,211

40. mosaicml/composer
    Supercharge Your Model Training
    🔗 docs.mosaicml.com
    ⭐ 4,833

41. pytorch/ignite
    High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
    🔗 pytorch-ignite.ai
    ⭐ 4,422

42. facebookincubator/AITemplate
    AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
    ⭐ 4,391

43. deci-ai/super-gradients
    Easily train or fine-tune SOTA computer vision models with one open source training library. The home of Yolo-NAS.
    🔗 www.supergradients.com
    ⭐ 4,193

44. williamyang1991/VToonify
    [SIGGRAPH Asia 2022] VToonify: Controllable High-Resolution Portrait Video Style Transfer
    ⭐ 3,432

45. facebookresearch/PyTorch-BigGraph
    Generate embeddings from large-scale graph-structured data.
    🔗 torchbiggraph.readthedocs.io
    ⭐ 3,339

46. alpa-projects/alpa
    Training and serving large-scale neural networks with auto parallelization.
    🔗 alpa.ai
    ⭐ 2,947

47. pytorch/botorch
    Bayesian optimization in PyTorch
    🔗 botorch.org
    ⭐ 2,898

48. cvg/LightGlue
    LightGlue: Local Feature Matching at Light Speed (ICCV 2023)
    ⭐ 2,779

49. explosion/thinc
    🔮 A refreshing functional take on deep learning, compatible with your favorite libraries
    🔗 thinc.ai
    ⭐ 2,776

50. deepmind/dm-haiku
    JAX-based neural network library
    🔗 dm-haiku.readthedocs.io
    ⭐ 2,697

51. nerdyrodent/VQGAN-CLIP
    Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.
    ⭐ 2,547

52. danielegrattarola/spektral
    Graph Neural Networks with Keras and Tensorflow 2.
    🔗 graphneural.network
    ⭐ 2,324

53. google-research/electra
    ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
    ⭐ 2,274

54. neuralmagic/sparseml
    Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
    ⭐ 1,924

55. fepegar/torchio
    Medical imaging toolkit for deep learning
    🔗 www.torchio.org
    ⭐ 1,921

56. pytorch/torchrec
    Pytorch domain library for recommendation systems
    ⭐ 1,658

57. vt-vl-lab/FGVC
    [ECCV 2020] Flow-edge Guided Video Completion
    ⭐ 1,524

58. tensorflow/mesh
    Mesh TensorFlow: Model Parallelism Made Easier
    ⭐ 1,503

59. tensorly/tensorly
    TensorLy: Tensor Learning in Python.
    🔗 tensorly.org
    ⭐ 1,479

60. calculatedcontent/WeightWatcher
    The WeightWatcher tool for predicting the accuracy of Deep Neural Networks
    ⭐ 1,368

61. hysts/pytorch_image_classification
    PyTorch implementation of image classification models for CIFAR-10/CIFAR-100/MNIST/FashionMNIST/Kuzushiji-MNIST/ImageNet
    ⭐ 1,293

62. xl0/lovely-tensors
    Tensors, ready for human consumption
    🔗 xl0.github.io/lovely-tensors
    ⭐ 1,026

63. tensorflow/similarity
    TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
    ⭐ 993

64. jeshraghian/snntorch
    Deep and online learning with spiking neural networks in Python
    🔗 snntorch.readthedocs.io/en/latest
    ⭐ 956

65. deepmind/android_env
    RL research on Android devices.
    ⭐ 939

66. keras-team/keras-cv
    Industry-strength Computer Vision workflows with Keras
    ⭐ 903

67. deepmind/chex
    Chex is a library of utilities for helping to write reliable JAX code
    🔗 chex.readthedocs.io
    ⭐ 684

68. kakaobrain/rq-vae-transformer
    The official implementation of Autoregressive Image Generation using Residual Quantization (CVPR '22)
    ⭐ 655

69. whitead/dmol-book
    Deep learning for molecules and materials book
    🔗 dmol.pub
    ⭐ 561

Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training.

1. slundberg/shap
   A game theoretic approach to explain the output of any machine learning model.
   🔗 shap.readthedocs.io
   ⭐ 21,186

2. marcotcr/lime
   Lime: Explaining the predictions of any machine learning classifier
   ⭐ 11,145

3. interpretml/interpret
   Fit interpretable models. Explain blackbox machine learning.
   🔗 interpret.ml/docs
   ⭐ 5,914

4. tensorflow/lucid
   A collection of infrastructure and tools for research in neural network interpretability.
   ⭐ 4,600

5. pytorch/captum
   Model interpretability and understanding for PyTorch
   🔗 captum.ai
   ⭐ 4,443

6. pair-code/lit
   The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic interface.
   🔗 pair-code.github.io/lit
   ⭐ 3,289

7. seldonio/alibi
   Algorithms for explaining machine learning models
   🔗 docs.seldon.io/projects/alibi/en/stable
   ⭐ 2,271

8. oegedijk/explainerdashboard
   Quickly build Explainable AI dashboards that show the inner workings of so-called "blackbox" machine learning models.
   🔗 explainerdashboard.readthedocs.io
   ⭐ 2,147

9. arize-ai/phoenix
   AI Observability & Evaluation - Evaluate, troubleshoot, and fine tune your LLM, CV, and NLP models in a notebook.
   🔗 docs.arize.com/phoenix
   ⭐ 2,134

10. eleutherai/pythia
    Interpretability analysis and scaling laws to understand how knowledge develops and evolves during training in autoregressive transformers
    ⭐ 1,886

11. jalammar/ecco
    Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
    🔗 ecco.readthedocs.io
    ⭐ 1,868

12. cdpierse/transformers-interpret
    Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.
    ⭐ 1,180

13. selfexplainml/PiML-Toolbox
    PiML (Python Interpretable Machine Learning) toolbox for model development & diagnostics
    🔗 selfexplainml.github.io/piml-toolbox
    ⭐ 820

MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models.

1. apache/airflow
   Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
   🔗 airflow.apache.org
   ⭐ 33,587

2. ray-project/ray
   Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
   🔗 ray.io
   ⭐ 29,976

3. spotify/luigi
   Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
   ⭐ 17,132

4. mlflow/mlflow
   Open source platform for the machine learning lifecycle
   🔗 mlflow.org
   ⭐ 16,793

5. prefecthq/prefect
   Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
   🔗 prefect.io
   ⭐ 14,077

6. horovod/horovod
   Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
   🔗 horovod.ai
   ⭐ 13,812

7. iterative/dvc
   🦉 ML Experiments Management with Git
   🔗 dvc.org
   ⭐ 12,890

8. ludwig-ai/ludwig
   Low-code framework for building custom LLMs, neural networks, and other AI models
   🔗 ludwig.ai
   ⭐ 10,538

9. dagster-io/dagster
   An orchestration platform for the development, production, and observation of data assets.
   🔗 dagster.io
   ⭐ 9,660

10. great-expectations/great_expectations
    Always know what to expect from your data.
    🔗 docs.greatexpectations.io
    ⭐ 9,264

11. kedro-org/kedro
    Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
    🔗 kedro.org
    ⭐ 9,206

12. dbt-labs/dbt-core
    dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
    🔗 getdbt.com
    ⭐ 8,529

13. bentoml/OpenLLM
    Operating LLMs in production
    🔗 bentoml.com
    ⭐ 8,175

14. activeloopai/deeplake
    Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
    🔗 activeloop.ai
    ⭐ 7,495

15. netflix/metaflow
    🚀 Build and manage real-life ML, AI, and data science projects with ease!
    🔗 metaflow.org
    ⭐ 7,384

16. mage-ai/mage-ai
    🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
    🔗 www.mage.ai
    ⭐ 6,554

17. bentoml/BentoML
    Build Production-Grade AI Applications
    🔗 bentoml.com
    ⭐ 6,310

18. kestra-io/kestra
    Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
    🔗 kestra.io
    ⭐ 5,357

19. feast-dev/feast
    Feature Store for Machine Learning
    🔗 feast.dev
    ⭐ 5,107

20. allegroai/clearml
    ClearML - Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management
    🔗 clear.ml/docs
    ⭐ 5,076

21. aimhubio/aim
    Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
    🔗 aimstack.io
    ⭐ 4,615

22. flyteorg/flyte
    Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
    🔗 flyte.org
    ⭐ 4,538

23. evidentlyai/evidently
    Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b
    ⭐ 4,414

24. orchest/orchest
    Build data pipelines, the easy way 🛠️
    🔗 orchest.readthedocs.io/en/stable
    ⭐ 4,012

25. adap/flower
    Flower: A Friendly Federated Learning Framework
    🔗 flower.ai
    ⭐ 3,736

26. zenml-io/zenml
    ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
    🔗 zenml.io
    ⭐ 3,521

27. polyaxon/polyaxon
    MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
    🔗 polyaxon.com
    ⭐ 3,452

28. kubeflow/pipelines
    Machine Learning Pipelines for Kubeflow
    🔗 www.kubeflow.org/docs/components/pipelines
    ⭐ 3,380

29. ploomber/ploomber
    The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
    🔗 docs.ploomber.io
    ⭐ 3,335

30. towhee-io/towhee
    Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
    🔗 towhee.io
    ⭐ 2,908

31. determined-ai/determined
    Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
    🔗 determined.ai
    ⭐ 2,751

32. leptonai/leptonai
    A Pythonic framework to simplify AI service building
    🔗 lepton.ai
    ⭐ 2,170

33. meltano/meltano
    Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
    🔗 meltano.com
    ⭐ 1,504

34. hi-primus/optimus
    🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
    🔗 hi-optimus.com
    ⭐ 1,429

35. kubeflow/examples
    A repository to host extended examples and tutorials
    ⭐ 1,363

36. dagworks-inc/hamilton
    Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
    🔗 hamilton.dagworks.io/en/latest
    ⭐ 1,186

37. dstackai/dstack
    dstack is an open-source engine for running GPU workloads. It simplifies development, training, and deployment of gen AI models on any cloud. Discord: https://discord.gg/u8SmfwPpMd
    🔗 dstack.ai
    ⭐ 1,001

38. tensorflow/data-validation
    Library for exploring and validating machine learning data
    ⭐ 743

39. kedro-org/kedro-viz
    Visualise your Kedro data and machine-learning pipelines and track your experiments.
    🔗 demo.kedro.org
    ⭐ 629

40. nccr-itmo/FEDOT
    Automated modeling and machine learning framework FEDOT
    🔗 fedot.readthedocs.io
    ⭐ 590

Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF

1. openai/gym
   A toolkit for developing and comparing reinforcement learning algorithms.
   🔗 www.gymlibrary.dev
   ⭐ 33,546

2. unity-technologies/ml-agents
   The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
   🔗 unity.com/products/machine-learning-agents
   ⭐ 16,021

3. openai/baselines
   OpenAI Baselines: high-quality implementations of reinforcement learning algorithms
   ⭐ 15,177

4. google/dopamine
   Dopamine is a research framework for fast prototyping of reinforcement learning algorithms.
   🔗 github.com/google/dopamine
   ⭐ 10,319

5. deepmind/pysc2
   StarCraft II Learning Environment
   ⭐ 7,880

6. lucidrains/PaLM-rlhf-pytorch
   Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
   ⭐ 7,547

7. tensorlayer/TensorLayer
   Deep Learning and Reinforcement Learning Library for Scientists and Engineers
   🔗 tensorlayerx.com
   ⭐ 7,276

8. thu-ml/tianshou
   An elegant PyTorch deep reinforcement learning library.
   🔗 tianshou.readthedocs.io
   ⭐ 7,159

9. keras-rl/keras-rl
   Deep Reinforcement Learning for Keras.
   🔗 keras-rl.readthedocs.io
   ⭐ 5,473

10. farama-foundation/Gymnasium
    An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)
    🔗 gymnasium.farama.org
    ⭐ 5,033

11. facebookresearch/ReAgent
    A platform for Reasoning systems (Reinforcement Learning, Contextual Bandits, etc.)
    🔗 reagent.ai
    ⭐ 3,505

12. deepmind/dm_control
    Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.
    ⭐ 3,448

13. deepmind/acme
    A library of reinforcement learning components and agents
    ⭐ 3,323

14. ai4finance-foundation/ElegantRL
    Massively Parallel Deep Reinforcement Learning. 🔥
    🔗 discord.gg/trsr8sxpw5
    ⭐ 3,319

15. eureka-research/Eureka
    Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models"
    🔗 eureka-research.github.io
    ⭐ 2,470

16. pettingzoo-team/PettingZoo
    An API standard for multi-agent reinforcement learning environments, with popular reference environments and related utilities
    🔗 pettingzoo.farama.org
    ⭐ 2,260

17. kzl/decision-transformer
    Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.
    ⭐ 2,059

18. pytorch/rl
    A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
    🔗 pytorch.org/rl
    ⭐ 1,712

19. anthropics/hh-rlhf
    Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
    🔗 arxiv.org/abs/2204.05862
    ⭐ 1,347

20. humancompatibleai/imitation
    Clean PyTorch implementations of imitation and reward learning algorithms
    🔗 imitation.readthedocs.io
    ⭐ 1,086

21. arise-initiative/robosuite
    robosuite: A Modular Simulation Framework and Benchmark for Robot Learning
    🔗 robosuite.ai
    ⭐ 1,013

Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover.

1. huggingface/transformers
   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
   🔗 huggingface.co/transformers
   ⭐ 120,404

2. pytorch/fairseq
   Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
   ⭐ 28,712

3. explosion/spaCy
   💫 Industrial-strength Natural Language Processing (NLP) in Python
   🔗 spacy.io
   ⭐ 28,292

4. huggingface/datasets
   🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
   🔗 huggingface.co/docs/datasets
   ⭐ 18,046

5. microsoft/unilm
   Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
   🔗 aka.ms/generalai
   ⭐ 17,130

6. rare-technologies/gensim
   Topic Modelling for Humans
   🔗 radimrehurek.com/gensim
   ⭐ 15,008

7. myshell-ai/OpenVoice
   Instant voice cloning by MyShell.
   🔗 research.myshell.ai/open-voice
   ⭐ 14,311

8. gunthercox/ChatterBot
   ChatterBot is a machine learning, conversational dialog engine for creating chat bots
   🔗 chatterbot.readthedocs.io
   ⭐ 13,827

9. flairnlp/flair
   A very simple framework for state-of-the-art Natural Language Processing (NLP)
   🔗 flairnlp.github.io/flair
   ⭐ 13,416

10. ukplab/sentence-transformers
    Multilingual Sentence & Image Embeddings with BERT
    🔗 www.sbert.net
    ⭐ 13,146

11. nltk/nltk
    NLTK Source
    🔗 www.nltk.org
    ⭐ 12,809

12. jina-ai/clip-as-service
    🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
    🔗 clip-as-service.jina.ai
    ⭐ 12,095

13. allenai/allennlp
    An open-source NLP research library, built on PyTorch.
    🔗 www.allennlp.org
    ⭐ 11,653

14. facebookresearch/ParlAI
    A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
    🔗 parl.ai
    ⭐ 10,407

15. facebookresearch/seamless_communication
    Foundational Models for State-of-the-Art Speech and Text Translation
    ⭐ 9,721

16. nvidia/NeMo
    NeMo: a framework for generative AI
    🔗 docs.nvidia.com/nemo-framework/user-guide/latest/index.html
    ⭐ 9,316

17. google/sentencepiece
    Unsupervised text tokenizer for Neural Network-based text generation.
    ⭐ 8,986

18. togethercomputer/OpenChatKit
    OpenChatKit provides a powerful, open-source base to create both specialized and general purpose chatbots
    ⭐ 8,973

19. sloria/TextBlob
    Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
    🔗 textblob.readthedocs.io
    ⭐ 8,847

20. doccano/doccano
    Open source annotation tool for machine learning practitioners.
    🔗 doccano.herokuapp.com
    ⭐ 8,753

21. clips/pattern
    Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
    🔗 github.com/clips/pattern/wiki
    ⭐ 8,629

22. openai/tiktoken
    tiktoken is a fast BPE tokeniser for use with OpenAI's models.
    ⭐ 8,559

23. m-bain/whisperX
    WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
    ⭐ 7,923

24. espnet/espnet
    End-to-End Speech Processing Toolkit
    🔗 espnet.github.io/espnet
    ⭐ 7,629

25. facebookresearch/nougat
    Implementation of Nougat Neural Optical Understanding for Academic Documents
    🔗 facebookresearch.github.io/nougat
    ⭐ 7,621

26. speechbrain/speechbrain
    A PyTorch-based Speech Toolkit
    🔗 speechbrain.github.io
    ⭐ 7,280

27. vikparuchuri/marker
    Marker converts PDF, EPUB, and MOBI to markdown. It's 10x faster than nougat, more accurate on most documents, and has low hallucination risk.
    ⭐ 6,565

28. deeppavlov/DeepPavlov
    An open source library for deep learning end-to-end dialog systems and chatbots.
    🔗 deeppavlov.ai
    ⭐ 6,480

29. neuml/txtai
    💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
    🔗 neuml.github.io/txtai
    ⭐ 6,465

30. facebookresearch/metaseq
    A codebase for working with Open Pre-trained Transformers, originally forked from fairseq.
    ⭐ 6,323

31. kingoflolz/mesh-transformer-jax
    Model parallel transformers in JAX and Haiku
    ⭐ 6,182

32. maartengr/BERTopic
    Leveraging BERT and c-TF-IDF to create easily interpretable topics.
    🔗 maartengr.github.io/bertopic
    ⭐ 5,288

33. minimaxir/textgenrnn
    Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
    ⭐ 4,939

34. vikparuchuri/surya
    OCR and line detection in 90+ languages
    ⭐ 4,786

35. salesforce/CodeGen
    CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
    ⭐ 4,666

36. facebookresearch/DrQA
    Reading Wikipedia to Answer Open-Domain Questions
    ⭐ 4,441

37. prefecthq/marvin
    ✨ Build AI interfaces that spark joy
    🔗 askmarvin.ai
    ⭐ 4,404

38. aiwaves-cn/agents
    An Open-source Framework for Autonomous Language Agents
    🔗 www.aiwaves-agents.com
    ⭐ 4,326

39. layout-parser/layout-parser
    A Unified Toolkit for Deep Learning Based Document Image Analysis
    🔗 layout-parser.github.io
    ⭐ 4,282

40. makcedward/nlpaug
    Data augmentation for NLP
    🔗 makcedward.github.io
    ⭐ 4,246

41. thilinarajapakse/simpletransformers
    Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
    🔗 simpletransformers.ai
    ⭐ 3,939

42. life4/textdistance
    📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
    ⭐ 3,266

43. jsvine/markovify
    A simple, extensible Markov chain generator.
    ⭐ 3,252

44. maartengr/KeyBERT
    Minimal keyword extraction with BERT
    🔗 maartengr.github.io/keybert
    ⭐ 3,103

45. bytedance/lightseq
    LightSeq: A High Performance Library for Sequence Processing and Generation
    ⭐ 3,046

46. errbotio/errbot
    Errbot is a chatbot, a daemon that connects to your favorite chat service and bring your tools and some fun into the conversation.
    🔗 errbot.io
    ⭐ 3,034

47. argilla-io/argilla
    ✨Argilla: the open-source feedback platform for LLMs
    🔗 docs.argilla.io
    ⭐ 2,930

48. huawei-noah/Pretrained-Language-Model
    Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
    ⭐ 2,924

49. promptslab/Promptify
    Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
    🔗 discord.gg/m88xfymbk6
    ⭐ 2,901

50. jbesomi/texthero
    Text preprocessing, representation and visualization from zero to hero.
    🔗 texthero.org
    ⭐ 2,851

51. ddangelov/Top2Vec
    Top2Vec learns jointly embedded topic, document and word vectors.
    ⭐ 2,795

52. huggingface/neuralcoref
    ✨Fast Coreference Resolution in spaCy with Neural Networks
    🔗 huggingface.co/coref
    ⭐ 2,786

53. neuralmagic/deepsparse
    Sparsity-aware deep learning inference runtime for CPUs
    🔗 neuralmagic.com/deepsparse
    ⭐ 2,778

54. salesforce/CodeT5
    Home of CodeT5: Open Code LLMs for Code Understanding and Generation
    🔗 arxiv.org/abs/2305.07922
    ⭐ 2,500

55. bigscience-workshop/promptsource
    Toolkit for creating, sharing and using natural language prompts.
    ⭐ 2,380

56. jamesturk/jellyfish
    🪼 a python library for doing approximate and phonetic matching of strings.
    🔗 jamesturk.github.io/jellyfish
    ⭐ 1,960

57. alibaba/EasyNLP
    EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
    ⭐ 1,884

58. huggingface/setfit
    Efficient few-shot learning with Sentence Transformers
    🔗 hf.co/docs/setfit
    ⭐ 1,854

59. thudm/P-tuning-v2
    An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
    ⭐ 1,820

60. deepset-ai/FARM
    🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
    🔗 farm.deepset.ai
    ⭐ 1,716

61. franck-dernoncourt/NeuroNER
    Named-entity recognition using neural networks. Easy-to-use and state-of-the-art results.
    🔗 neuroner.com
    ⭐ 1,673

62. featureform/featureform
    The Virtual Feature Store. Turn your existing data infrastructure into a feature store.
    🔗 www.featureform.com
    ⭐ 1,657

63. plasticityai/magnitude
    A fast, efficient universal vector embedding utility package.
    ⭐ 1,612

64. marella/ctransformers
    Python bindings for the Transformer models implemented in C/C++ using GGML library.
    ⭐ 1,606

65. arxiv-vanity/arxiv-vanity
    Renders papers from arXiv as responsive web pages so you don't have to squint at a PDF.
    🔗 www.arxiv-vanity.com
    ⭐ 1,585

66. google-research/language
    Shared repository for open-sourced projects from the Google AI Language team.
    🔗 ai.google/research/teams/language
    ⭐ 1,546

67. explosion/spacy-models
    💫 Models for the spaCy Natural Language Processing (NLP) library
    🔗 spacy.io
    ⭐ 1,482

68. chrismattmann/tika-python
    Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
    ⭐ 1,382

69. gunthercox/chatterbot-corpus
    A multilingual dialog corpus
    🔗 chatterbot-corpus.readthedocs.io
    ⭐ 1,334

70. jonasgeiping/cramming
    Cramming the training of a (BERT-type) language model into limited compute.
    ⭐ 1,208

71. abertsch72/unlimiformer
    Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"
    ⭐ 1,014

72. norskregnesentral/skweak
    skweak: A software toolkit for weak supervision applied to NLP tasks
    ⭐ 908

73. nomic-ai/nomic
    Interact, analyze and structure massive text, image, embedding, audio and video datasets
    🔗 atlas.nomic.ai
    ⭐ 907

74. pemistahl/lingua-py
    The most accurate natural language detection library for Python, suitable for short text and mixed-language text
    ⭐ 796

75. openai/grade-school-math
    GSM8K, a dataset of 8.5K high quality linguistically diverse grade school math word problems
    ⭐ 782

76. explosion/spacy-streamlit
    👑 spaCy building blocks and visualizers for Streamlit apps
    🔗 share.streamlit.io/ines/spacy-streamlit-demo/master/app.py
    ⭐ 753

77. paddlepaddle/RocketQA
    🚀 RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.
    ⭐ 727

78. intellabs/fastRAG
    Efficient Retrieval Augmentation and Generation Framework
    ⭐ 719

79. explosion/spacy-stanza
    💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy
    ⭐ 708

80. keras-team/keras-nlp
    Modular Natural Language Processing workflows with Keras
    ⭐ 635

Python packaging, dependency management and bundling.

1. pyenv/pyenv
   pyenv lets you easily switch between multiple versions of Python.
   ⭐ 35,504

2. python-poetry/poetry
   Python packaging and dependency management made easy
   🔗 python-poetry.org
   ⭐ 28,611

3. pypa/pipenv
   A virtualenv management tool that supports a multitude of systems and nicely bridges the gaps between pip, python and virtualenv.
   🔗 pipenv.pypa.io
   ⭐ 24,457

4. pyinstaller/pyinstaller
   Freeze (package) Python programs into stand-alone executables
   🔗 www.pyinstaller.org
   ⭐ 11,071

5. mitsuhiko/rye
   a Hassle-Free Python Experience
   🔗 rye-up.com
   ⭐ 9,990

6. pypa/pipx
   Install and Run Python Applications in Isolated Environments
   🔗 pipx.pypa.io
   ⭐ 8,182

7. jazzband/pip-tools
   A set of tools to keep your pinned Python dependencies fresh (pip-compile + pip-sync)
   🔗 pip-tools.rtfd.io
   ⭐ 7,358

8. pdm-project/pdm
   A modern Python package and dependency manager supporting the latest PEP standards
   🔗 pdm-project.org
   ⭐ 6,175

9. conda/conda
   A system-level, binary package and environment manager running on all major operating systems and platforms.
   🔗 docs.conda.io/projects/conda
   ⭐ 5,987

10. mamba-org/mamba
    The Fast Cross-Platform Package Manager: mamba is a reimplementation of the conda package manager in C++
    🔗 mamba.readthedocs.io
    ⭐ 5,868

11. astral-sh/uv
    An extremely fast Python package installer and resolver, written in Rust. Designed as a drop-in replacement for pip and pip-compile.
    🔗 astral.sh
    ⭐ 5,671

12. pypa/hatch
    Modern, extensible Python project management
    🔗 hatch.pypa.io/latest
    ⭐ 5,088

13. indygreg/PyOxidizer
    A modern Python application packaging and distribution tool
    ⭐ 5,063

14. conda-forge/miniforge
    A conda-forge distribution.
    🔗 conda-forge.org/miniforge
    ⭐ 4,848

15. pypa/virtualenv
    A tool to create isolated Python environments. Since Python 3.3, a subset of it has been integrated into the standard lib venv module.
    🔗 virtualenv.pypa.io
    ⭐ 4,642

16. spack/spack
    A flexible package manager that supports multiple versions, configurations, platforms, and compilers.
    🔗 spack.io
    ⭐ 3,852

17. pantsbuild/pex
    A tool for generating .pex (Python EXecutable) files, lock files and venvs.
    🔗 docs.pex-tool.org
    ⭐ 2,428

18. beeware/briefcase
    Tools to support converting a Python project into a standalone native application.
    🔗 briefcase.readthedocs.io
    ⭐ 2,247

19. pypa/flit
    Simplified packaging of Python modules
    🔗 flit.pypa.io
    ⭐ 2,070

20. linkedin/shiv
    shiv is a command line utility for building fully self contained Python zipapps as outlined in PEP 441, but with all their dependencies included.
    ⭐ 1,667

21. marcelotduarte/cx_Freeze
    Create standalone executables from Python scripts, with the same performance and is cross-platform.
    🔗 marcelotduarte.github.io/cx_freeze
    ⭐ 1,222

22. ofek/pyapp
    Runtime installer for Python applications
    🔗 ofek.dev/pyapp
    ⭐ 975

23. pypa/gh-action-pypi-publish
    The blessed GitHub Action, for publishing your 📦 distribution files to PyPI: https://github.com/marketplace/actions/pypi-publish
    🔗 packaging.python.org/guides/publishing-package-distribution-releases-using-github-actions-ci-cd-workflows
    ⭐ 795

24. py2exe/py2exe
    Create standalone Windows programs from Python code
    🔗 www.py2exe.org
    ⭐ 722

25. snok/install-poetry
    Github action for installing and configuring Poetry
    ⭐ 506

Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations.

1. pandas-dev/pandas
   Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
   🔗 pandas.pydata.org
   ⭐ 41,260

2. pola-rs/polars
   Dataframes powered by a multithreaded, vectorized query engine, written in Rust
   🔗 docs.pola.rs
   ⭐ 24,372

3. duckdb/duckdb
   DuckDB is an in-process SQL OLAP Database Management System
   🔗 www.duckdb.org
   ⭐ 14,676

4. ydataai/ydata-profiling
   1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
   🔗 docs.profiling.ydata.ai
   ⭐ 11,832

5. gventuri/pandas-ai
   Chat with your data (SQL, CSV, pandas, polars, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
   🔗 pandas-ai.com
   ⭐ 9,781

6. kanaries/pygwalker
   PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis
   🔗 kanaries.net/home/pygwalker
   ⭐ 8,895

7. rapidsai/cudf
   cuDF is a GPU DataFrame library for loading joining, aggregating, filtering, and otherwise manipulating data
   🔗 docs.rapids.ai/api/cudf/stable
   ⭐ 7,041

8. aws/aws-sdk-pandas
   pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
   🔗 aws-sdk-pandas.readthedocs.io
   ⭐ 3,745

9. nalepae/pandarallel
   A simple and efficient tool to parallelize Pandas operations on all available CPUs
   🔗 nalepae.github.io/pandarallel
   ⭐ 3,429

10. blaze/blaze
    NumPy and Pandas interface to Big Data
    🔗 blaze.pydata.org
    ⭐ 3,179

11. adamerose/PandasGUI
    A GUI for Pandas DataFrames
    ⭐ 3,096

12. unionai-oss/pandera
    A light-weight, flexible, and expressive statistical data testing library
    🔗 www.union.ai/pandera
    ⭐ 2,845

13. pydata/pandas-datareader
    Extract data from a wide range of Internet sources into a pandas DataFrame.
    🔗 pydata.github.io/pandas-datareader/stable/index.html
    ⭐ 2,789

14. scikit-learn-contrib/sklearn-pandas
    Pandas integration with sklearn
    ⭐ 2,774

15. jmcarpenter2/swifter
    A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner
    ⭐ 2,422

16. fugue-project/fugue
    A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
    🔗 fugue-tutorials.readthedocs.io
    ⭐ 1,830

17. delta-io/delta-rs
    A native Rust library for Delta Lake, with bindings into Python
    🔗 delta-io.github.io/delta-rs
    ⭐ 1,693

18. pyjanitor-devs/pyjanitor
    Clean APIs for data cleaning. Python implementation of R package Janitor
    🔗 pyjanitor-devs.github.io/pyjanitor
    ⭐ 1,254

19. machow/siuba
    Python library for using dplyr like syntax with pandas and SQL
    🔗 siuba.org
    ⭐ 1,086

20. eventual-inc/Daft
    Distributed DataFrame for Python designed for the cloud, powered by Rust
    🔗 getdaft.io
    ⭐ 1,039

21. tkrabel/bamboolib
    bamboolib - a GUI for pandas DataFrames
    🔗 bamboolib.com
    ⭐ 925

22. holoviz/hvplot
    A high-level plotting API for pandas, dask, xarray, and networkx built on HoloViews
    🔗 hvplot.holoviz.org
    ⭐ 902

23. renumics/spotlight
    Interactively explore unstructured datasets from your dataframe.
    🔗 renumics.com
    ⭐ 857

Performance, parallelisation and low level libraries.

1. celery/celery
   Distributed Task Queue (development branch)
   🔗 docs.celeryq.dev
   ⭐ 23,061

2. google/flatbuffers
   FlatBuffers: Memory Efficient Serialization Library
   🔗 flatbuffers.dev
   ⭐ 21,763

3. pybind/pybind11
   Seamless operability between C++11 and Python
   🔗 pybind11.readthedocs.io
   ⭐ 14,459

4. exaloop/codon
   A high-performance, zero-overhead, extensible Python compiler using LLVM
   🔗 docs.exaloop.io/codon
   ⭐ 13,684

5. dask/dask
   Parallel computing with task scheduling
   🔗 dask.org
   ⭐ 11,794

6. modin-project/modin
   Modin: Scale your Pandas workflows by changing a single line of code
   🔗 modin.readthedocs.io
   ⭐ 9,330

7. numba/numba
   NumPy aware dynamic Python compiler using LLVM
   🔗 numba.pydata.org
   ⭐ 9,250

8. nebuly-ai/nebuly
   The user analytics platform for LLMs
   🔗 www.nebuly.com
   ⭐ 8,345

9. vaexio/vaex
   Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
   🔗 vaex.io
   ⭐ 8,136

10. mher/flower
    Real-time monitor and web admin for Celery distributed task queue
    🔗 flower.readthedocs.io
    ⭐ 6,070

11. python-trio/trio
    Trio – a friendly Python library for async concurrency and I/O
    🔗 trio.readthedocs.io
    ⭐ 5,771

12. ultrajson/ultrajson
    Ultra fast JSON decoder and encoder written in C with Python bindings
    🔗 pypi.org/project/ujson
    ⭐ 4,202

13. facebookincubator/cinder
    Cinder is Meta's internal performance-oriented production version of CPython.
    🔗 trycinder.com
    ⭐ 3,341

14. tlkh/asitop
    Perf monitoring CLI tool for Apple Silicon
    🔗 tlkh.github.io/asitop
    ⭐ 2,549

15. ipython/ipyparallel
    IPython Parallel: Interactive Parallel Computing in Python
    🔗 ipyparallel.readthedocs.io
    ⭐ 2,532

16. h5py/h5py
    HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5 binary data format.
    🔗 www.h5py.org
    ⭐ 1,978

17. intel/intel-extension-for-transformers
    ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
    ⭐ 1,797

18. faster-cpython/ideas
    Discussion and work tracker for Faster CPython project.
    ⭐ 1,630

19. airtai/faststream
    FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.
    🔗 faststream.airt.ai/latest
    ⭐ 1,565

20. agronholm/anyio
    High level asynchronous concurrency and networking framework that works on top of either trio or asyncio
    ⭐ 1,526

21. dask/distributed
    A distributed task scheduler for Dask
    🔗 distributed.dask.org
    ⭐ 1,522

22. tiangolo/asyncer
    Asyncer, async and await, focused on developer experience.
    🔗 asyncer.tiangolo.com
    ⭐ 1,352

23. nschloe/perfplot
    📈 Performance analysis for Python snippets
    ⭐ 1,270

24. intel/intel-extension-for-pytorch
    A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
    ⭐ 1,207

25. intel/scikit-learn-intelex
    Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
    🔗 intel.github.io/scikit-learn-intelex
    ⭐ 1,128

26. markshannon/faster-cpython
    How to make CPython faster.
    ⭐ 934

27. zerointensity/pointers.py
    Bringing the hell of pointers to Python.
    🔗 pointers.zintensity.dev
    ⭐ 855

28. brandtbucher/specialist
    Visualize CPython 3.11's specializing, adaptive interpreter. 🔥
    ⭐ 608

Memory and CPU/GPU profiling tools and libraries.

1. bloomberg/memray
   Memray is a memory profiler for Python
   🔗 bloomberg.github.io/memray
   ⭐ 12,239

2. benfred/py-spy
   Sampling profiler for Python programs
   ⭐ 11,555

3. plasma-umass/scalene
   Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals
   ⭐ 10,924

4. joerick/pyinstrument
   🚴 Call stack profiler for Python. Shows you why your code is slow!
   🔗 pyinstrument.readthedocs.io
   ⭐ 5,966

5. pythonprofilers/memory_profiler
   Monitor Memory usage of Python code
   🔗 pypi.python.org/pypi/memory_profiler
   ⭐ 4,149

6. gaogaotiantian/viztracer
   VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution.
   🔗 viztracer.readthedocs.io
   ⭐ 4,117

7. reloadware/reloadium
   Hot Reloading, Profiling and AI debugging for Python
   🔗 reloadium.io
   ⭐ 2,647

8. pyutils/line_profiler
   Line-by-line profiling for Python
   ⭐ 2,371

9. jiffyclub/snakeviz
   An in-browser Python profile viewer
   🔗 jiffyclub.github.io/snakeviz
   ⭐ 2,182

10. p403n1x87/austin
    Python frame stack sampler for CPython
    🔗 pypi.org/project/austin-dist
    ⭐ 1,331

11. pythonspeed/filprofiler
    A Python memory profiler for data processing and scientific computing applications
    🔗 pythonspeed.com/products/filmemoryprofiler
    ⭐ 806