Elastic Libraries

34 Components & Libraries

Sortby

Elastic Libraries

:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex question answering, semantic search, text generation applications, and more.

This command installs everything needed for basic Pipelines that use an in-memory DocumentStore. If you want to install only the dependencies needed for model inference on your local hardware (not re…

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

Run all: To update later on, just run that command again. Alternatively, to update while avoiding the confirmation prompt: To sync dev-setup to your local home directory without Git, run the followin…

Bittorrent software for cats

pyenv eases the use of different Python versions, and as not all Linux distros offer 3.7 packages, it's right up our alley.

Archivy is a self-hostable knowledge repository that allows you to learn and retain information in your own personal and extensible wiki.

Archivy is a self-hostable knowledge repository that allows you to learn and retain information in your own personal and extensible wiki. Features: Upcoming: Then run this and enter a password to cre…

Represent, send, store and search multimodal data

To install DocArray from the CLI, run the following command: New to DocArray? Depending on your use case and background, there are multiple ways to learn about DocArray: This is particularly benefici…

news-please - an integrated web crawler and information extractor for news that just works

news-please supports three main use cases, which are explained in more detail in the following. It's super easy, we promise! news-please runs on Python 3.5+. You can access the core functionality of …

Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch

diskover is an open source file system indexer that uses Elasticsearch to index and manage data across heterogeneous storage systems. Using diskover, you are able to more effectively search and organ…

✨ Rubrix, open-source framework for data-centric NLP. Data annotation and monitoring for enterprise NLP

Why Rubrix? Interactive weak supervision. Building a news classifier with user search queries: Getting started with Rubrix is as easy as: Then simply run: After a few iterations of data annotation, w…

This is a package that allows indexing of django models in elasticsearch with elasticsearch-dsl-py.

Requirements

Research. Shared.

Zenodo, a CERN service, is an open dependable home for the long-tail of science, enabling researchers to share and preserve any research outputs in any size, any format and from any science. Copyrigh…

An open-source framework for real-time anomaly detection using Python, ElasticSearch and Kibana

An open-source framework for real-time anomaly detection using Python, Elasticsearch and Kibana. The recommended installation method is to use pip within a Python 3.x virtalenv. You can use dsio thro…

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

See Also: repos which contains hundreds more scripts and programs for Cloud, Big Data, SQL, NoSQL, Web and Linux. Hari Sekhon Cloud & Big Data Contractor, United Kingdom List all programs: Run an…

Invenio digital library framework

Invenio Framework is like a Swiss Army knife of battle-tested, safe and secure modules providing you with all the features you need to build a trusted digital repository.

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

Eland is a Python Elasticsearch client for exploring and analyzing data in Elasticsearch with a familiar Pandas-compatible API. Where possible the package uses existing Python APIs and data structur…

pytablewriter is a Python library to write a table in various formats: AsciiDoc / CSV / Elasticsearch / HTML / JavaScript / JSON / LaTeX / LDJSON / LTSV / Markdown / MediaWiki / NumPy / Excel / Pandas / Python / reStructuredText / SQLite / TOML / TSV.

Some of the formats require additional dependency packages, you can install these packages as follows: You can apply styles to specific cells by using style filters. Style filters will be written as …

An analytical framework for network traffic and behavioral analytics

Flare is a network analytic framework designed for data scientists, security researchers, and network professionals. Written in Python, it is designed for rapid prototyping and development of behavio…

A tool for batch loading data files (json, parquet, csv, tsv) into ElasticSearch

Cloud-native distributed Python logging library to emit JSON log that can be easily indexed by logging infrastructure

Install by running this command: pip install json-logging you need to explicitly set JSONRequestLogFormatter as default formatter for any extra handler that is added to request_logger Current request…

Netflix like full-stack application with SPA client and backend implemented in service oriented architecture

dependent on ElasticSearch as data source install dependencies & start Movie-Service dependent on PostgreSQL as data source install dependencies & start User-Service This project is licensed …

Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database

Query and report user logons relations from MS Windows Security Events

This tool automates the process of creating logon relations from MS Windows Security Events by showing a graphical relation among users domains, source and destination logons as well as session durat…

Differentiable elastic deformations for N-dimensional images (Python, SciPy, NumPy, TensorFlow, PyTorch).

This library implements elastic grid-based deformations for N-dimensional images. The elastic deformation approach is described in The procedure generates a coarse displacement grid with a random dis…

DynamiteNSM is a free Network Security Monitor developed by Dynamite Analytics to enable network visibility and advanced cyber threat detection

Checkout our comprehensive documentation complete with tutorials, guides, and example quickstart deployments.

Detecting Lateral Movement with Machine Learning

Each tools require the following modules: or The log has three levels of detection level

FastAPI & Kubernetes Tutorial with PyCharm

Welcome to the FastAPI & Kubernetes Tutorial Series with PyCharm & AWS EKS. Before starting up this project, make sure you have an AWS account and PyCharm installed in your machine. Make sure…

gathers Python stack for DevOps, these are usually my basic templates use for my implementations, so, feel free to use it and evolve it! Everything is Docker!

Every folders contain .yml for docker-compose. You need to install Docker-Compose first. To run, To safely close To remove all images To remove all containers

The tool which imports raw JSON to ElasticSearch in one line of commands

Alexander Liu Very fast -- 4 to 10 times faster when processing big data. If the json data file is valid: If the json data file is invalid: No multi-threads And it works. And it works.