Nlp Libraries

84 Components & Libraries

Sortby

Nlp Libraries

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow 🤗 Transformers provides thousands of pretrained models to perform tasks on different modalities such as text, vision, and audio. Thes…

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

An open-source NLP research library, built on PyTorch.

An Apache 2.0 NLP research library, built on PyTorch, for developing state-of-the-art deep learning models on a wide variety of linguistic tasks. When you're ready to start your project, we…

:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex question answering, semantic search, text generation applications, and more.

This command installs everything needed for basic Pipelines that use an in-memory DocumentStore. If you want to install only the dependencies needed for model inference on your local hardware (not re…

Mycroft Core, the Mycroft Artificial Intelligence platform.

Mycroft is a hackable open source voice assistant. NOTE: The default branch for this repository is 'dev', which should be considered a work-in-progress. If you want to clone a more stable version, sw…

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

txtai is an all-in-one embeddings database for semantic search, LLM orchestration and language model workflows. Embeddings databases are a union of vector indexes (sparse and dense), graph networks a…

Transforms PDF, Documents and Images into Enriched Structured Data

It provides analysts, data scientists and developers with clean structured and label-enriched information set for ready-to-use applications ranging from data entry and document analysts automation, a…

Snips Python library to extract meaning from text

Behind every chatbot and voice assistant lies a common piece of technology: Natural Language Understanding (NLU). Anytime a user interacts with an AI using natural language, their words need to be tr…

🛠 All-in-one web-based IDE specialized for machine learning and data science.

The ML workspace is an all-in-one web-based IDE specialized for machine learning and data science. It is simple to deploy and gets you started within minutes to productively built ML solutions on you…

Open-source offline translation library written in Python

Argos Translate also manages automatically pivoting through intermediate languages to translate between languages that don't have a direct translation between them installed. For example, if you have…

A library for debugging/inspecting machine learning classifiers and explaining their predictions

ELI5 is a Python package which helps to debug machine learning classifiers and explain their predictions. It provides support for the following machine learning frameworks and packages: License is MI…

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

Trafilatura consistently outperforms other open-source libraries in text extraction benchmarks, showcasing its efficiency and accuracy in extracting web content. The extractor tries to strike a balan…

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

TextAttack is a Python framework for adversarial attacks, data augmentation, and model training in NLP. There are lots of reasons to use TextAttack: You should be running Python 3.6+ to use this pack…

Data Science Roadmap from A to Z

Pandas

Library to scrape and clean web pages to create massive datasets.

A straightforward library that allows you to crawl, clean up, and deduplicate webpages to create massive monolingual datasets. Using this library, you should be able to create datasets larger than th…

Python implementation of TextRank algorithms ("textgraphs") for phrase extraction

Popular use cases for this library include: If you work directly from this Git repo, be sure to install the dependencies as well: Then to use the library with a simple use case: We welcome people get…

news-please - an integrated web crawler and information extractor for news that just works

news-please supports three main use cases, which are explained in more detail in the following. It's super easy, we promise! news-please runs on Python 3.5+. You can access the core functionality of …

✨ Argilla: Open-source platform to build better language models through human feedback

Argilla Client: a powerful Python library for reading and writing data into Argilla, using all the libraries you love (transformers, spaCy, datasets, and any other). Argilla Server and UI: the API an…

Learn how to process, classify, cluster, summarize, understand syntax, semantics and sentiment of text data with the power of Python! This repository contains code and datasets used in my book, "Text Analytics with Python" published by Apress/Springer.

Text analytics can be a bit overwhelming and frustrating at times with the unstructured and noisy nature of textual data and the vast amount of information available. "Text Analytics with Python" is …

Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.

This makes Apache Tika available as a Python library, installable via Setuptools, Pip and Easy Install. To use this library, you need to have Java 7+ installed on your system as tika-python starts up…

✨ Rubrix, open-source framework for data-centric NLP. Data annotation and monitoring for enterprise NLP

Why Rubrix? Interactive weak supervision. Building a news classifier with user search queries: Getting started with Rubrix is as easy as: Then simply run: After a few iterations of data annotation, w…

The data scientist's open-source choice to scale, assess and maintain natural language data. Treat training data like a software artifact.

Does one of these scenarios sounds familiar to you? If so, you are one of the people we've built refinery for. refinery helps you to build better NLP models in a data-centric approach. Semi-automate …

My first Python repo with codes in Machine Learning, NLP and Deep Learning with Keras and Theano

Codes in NLP, Deep Learning, Reinforcement Learning and Artificial Intelligence I am a Data Scientist and I code in R, Python and Wolfram Mathematica. Here you will find some Machine Learning, Deep L…

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch The content of this document is organized as follows: Two simpler at…

MLNLP社区用来更好进行论文搜索的工具。Fully-automated scripts for collecting AI-related papers

Fully-automated scripts for collecting AI-related papers. This project exists thanks to all the people who contribute.

Collection of open-source libraries and tools for Robotic Process Automation (RPA), designed to be used with both Robot Framework and Python

Table of Contents The RPA Framework project currently includes the following libraries: To install all extra packages (including Playwright dependencies), you can use: Note Python 3.8 or higher is re…

Obsei is a low code AI powered automation tool. It can be used in various business flows like social listening, AI based alerting, brand image analysis, comparative study and more .

All the Observers can store their state in databases (Sqlite, Postgres, MySQL, etc.), making Obsei suitable for scheduled jobs or serverless applications. Install the following (if not present alread…