Language-models Libraries

12 Components & Libraries

Sortby

Language-models Libraries

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow 🤗 Transformers provides thousands of pretrained models to perform tasks on different modalities such as text, vision, and audio. Thes…

:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex question answering, semantic search, text generation applications, and more.

This command installs everything needed for basic Pipelines that use an in-memory DocumentStore. If you want to install only the dependencies needed for model inference on your local hardware (not re…

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

txtai is an all-in-one embeddings database for semantic search, LLM orchestration and language model workflows. Embeddings databases are a union of vector indexes (sparse and dense), graph networks a…

Open-source offline translation library written in Python

Argos Translate also manages automatically pivoting through intermediate languages to translate between languages that don't have a direct translation between them installed. For example, if you have…

Machine Learning Engineering Online Book

An open collection of methodologies to help with successful training of large language models and multi-modal models. This is a technical material suitable for LLM/VLM training engineers and operator…

🪢 Open source LLM engineering platform. Observability, metrics, evals, prompt management, testing -- 🍊YC W23 🤖 integrate via Typescript, Python, OpenAI, Langchain, LlamaIndex, Litellm

Managed deployment by the Langfuse team, generous free-tier (hobby plan), no credit card required. You may want to use another integration to get started quickly or implement a use case that we do no…

Swirl is open-source software that uses AI to simultaneously search multiple content and data sources, finds the best results using a reader LLM, then prompts Generative AI, enabling you to get answers from your own data.

Swirl is open source software that simultaneously searches multiple content sources and returns AI ranked results. Prompt your choice of Generative AI using the top N results to get answers incorpora…

ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.

Multi-Agent Language Game Environments for LLMs ChatArena is a library that provides multi-agent language game environments and facilitates research about autonomous LLM agents and their social inter…

ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.

Ship RAG based LLM web apps in seconds.

for built-in data readers (github, pdf, docx, ipynb, epub, mbox, websites..), install with: huggingface - ollama example: microsoft azure - openai example: google - vertexai example: aws bedrock - cl…

⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops

LangCorn is an API server that enables you to serve LangChain models and pipelines with ease, leveraging the power of FastAPI for a robust and efficient experience. To get started with LangCorn, simp…