Storage Libraries

15 Components & Libraries

Sortby

Storage Libraries

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Linkis builds a layer of computation middleware between upper applications and underlying engines. By using standard interfaces such as REST/WS/JDBC provided by Linkis, the upper applications can eas…

Easy to use cryptographic framework for data protection: secure messaging with forward secrecy and secure data storage. Has unified APIs across 14 platforms.

Themis is an open-source high-level cryptographic services library for securing data during authentication, storage, messaging, network exchange, etc. Themis solves 90% of typical data protection use…

A modern, web-based photo management server. Run it on your home server and it will let you find the right photo from your collection on any device. Smart filtering is made possible by object recognition, face recognition, location awareness, color analysis and other ML algorithms.

This is a photo management application based on web technologies. Run it on your home server and it will let you find what you want from your photo collection using any device. Smart filtering is mad…

Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch

diskover is an open source file system indexer that uses Elasticsearch to index and manage data across heterogeneous storage systems. Using diskover, you are able to more effectively search and organ…

Python library for serializing any arbitrary object graph into JSON. It can take almost any Python object and turn the object into JSON. Additionally, it can reconstitute the object back into Python.

Warning jsonpickle can execute arbitrary Python code. Please see the Security section for more details. Data serialized with python's pickle (or cPickle or dill) is not easily readable outside of pyt…

📼 Package media content for online streaming(DASH and HLS) using FFmpeg

First of all, you need to import the package in your code: There are several ways to open a resource. Create DASH files: Generate representations manually: Create HLS files: Generate representations …

Keep code, data, containers under control with git and git-annex

will install the most recently released version, and release candidates are available via MIT/Expat The DataLad project received support through the following grants: US-German collaboration in compu…

File Injector is a script that allows you to store any file in an image using steganography

If that doesn't work, you can try: You don't need to choose a particular one when decrypting a file, it will be selected automatically from the folder. [0] Existing key [1] New key

hivemq-mqtt-tensorflow-kafka-realtime-iot-machine-learning-training-inference

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

You want to see an IoT example at huge scale? Not just 100 or 1000 devices producing data, but a really scalable demo with millions of messages per second from tens of thousands of devices? This is t…

🏬 modelstore is a Python library that allows you to version, export, and save a machine learning model to your filesystem or a cloud storage provider.

✅ No tracking server required ✅ Upload and version all your models ✅ Manage models by domains and states ✅ Download or load straight into memory ✅ Use as a command line tool Is there a machine learni…

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

Lithops is a Python multi-cloud distributed computing framework. It allows you to run unmodified local python code at massive scale in the main serverless computing platforms. Lithops delivers the u…

A python NoSQL dictionary database, with concurrent access and ACID compliance

DictDataBase is a fast document-based database that uses json files or compressed json files for storage. Set storage_directory to the path of the directory that will contain your json files: You can…

Elara DB is an easy to use, lightweight persistent key-value store that can also be used as a fast in-memory cache. Manipulate data structures in-memory, encrypt database files and export data. :dart:

Elara DB is an easy to use, lightweight key-value database written for python that can also be used as a fast in-memory cache for JSON-serializable data. Includes various methods and features to mani…

OptimizeRasters is a set of tools for converting raster data to optimized Tiled TIF or MRF files, moving data to cloud storage, and creating Raster Proxies.

OptimizeRasters is a set of tools for accomplishing three tasks: converting raster data to optimized file formats, moving data to cloud storage, and creating raster proxies. The result is more effici…

Ballcone is a fast and lightweight server-side Web analytics solution.

Ballcone is a fast and lightweight server-side Web analytics solution. It requires no JavaScript on your website. For better performance, Ballcone inserts data in batches, committing them to DuckDB e…

Related tags

artificial-intelligence