Metadata Libraries

17 Components & Libraries

Sortby

Metadata Libraries

An orchestration platform for the development, production, and observation of data assets.

With Dagster, you declare—as Python functions—the data assets that you want to build. Dagster then helps you run your functions at the right time and keep your assets up-to-date. Here is an example o…

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

Aim is an open-source, self-hosted ML experiment tracking tool designed to handle 10,000s of training runs. Aim provides a performant and beautiful UI for exploring and comparing training runs. Addit…

Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch

diskover is an open source file system indexer that uses Elasticsearch to index and manage data across heterogeneous storage systems. Using diskover, you are able to more effectively search and organ…

Tern is a software composition analysis tool and Python library that generates a Software Bill of Materials for container images and Dockerfiles. The SBOM that Tern generates will give you a layer-by-layer view of what's inside your container in a variety of formats including human-readable, JSON, HTML, SPDX and more.

Tern is a software package inspection tool that can create a Software Bill of Materials (SBOM) for containers. It's written in Python3 with a smattering of shell scripts. Tern is an inspection tool t…

Easy to use Python module to extract Exif metadata from digital image files.

Easy to use Python module to extract Exif metadata from digital image files. Supported formats: TIFF, JPEG, PNG, Webp, HEIC EXIF.py is tested and officially supported on Python 3.5 to 3.11 EXIF.py is…

FATT /fingerprintAllTheThings - a pyshark based script for extracting network metadata and fingerprints from pcap files and live network traffic

fingerprint all the things! More info about the fingerprinting methods, sample use-cases and research results will be added to the repo soon. Stay tuned! OR just install pyshark if you don't want to …

Collective Mind (CM) is a collection of portable and extensible automation recipes with a unified and human-friendly interface and minimal dependencies to make it easier to compose, benchmark and optimize AI, ML and other applications and systems across diverse and continuously changing models, data sets, software and hardware (cloud/edge)

For example, you should be able to run the MLPerf inference benchmark on Linux, Windows and MacOS using a few CM commands: You can also run the same commands using a unified CM Python API:

pycsw is an OGC CSW server implementation written in Python. pycsw fully implements the OpenGIS Catalogue Service Implementation Specification [Catalogue Service for the Web]. Initial development started in 2010 (more formally announced in 2011). The project is certified OGC Compliant, and is an OGC Reference Implementation. pycsw allows for the publishing and discovery of geospatial metadata via numerous APIs (CSW 2/CSW 3, OpenSearch, OAI-PMH, SRU). Existing repositories of geospatial metadata can also be exposed, providing a standards-based metadata and catalogue component of spatial data infrastructures. pycsw is Open Source, released under an MIT license, and runs on all major platforms (Windows, Linux, Mac OS X). Please read the docs at https://pycsw.org/docs for more information.

pycsw allows for the publishing and discovery of geospatial metadata via numerous APIs (OGC API - Records, CSW 2/CSW 3, OpenSearch, OAI-PMH, SRU). Existing repositories of geospatial metadata can als…

Image Reading, Metadata Conversion, and Image Writing for Microscopy Images in Python

Image Reading, Metadata Conversion, and Image Writing for Microscopy Images in Pure Python Supports reading metadata and imaging data for: Supports writing metadata and imaging data for: AICSImageIO …

🕵️ Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.

Metadata, in the realm of cybersecurity, is more than just embedded information; it's a gateway to insightful perspectives, often unveiling crucial leads in OSINT and pentesting. Drawing inspiration …

Python Library to download images and metadata from popular search engines.

A simple python package for saving images from Bing and Google without using API keys. This package utilizes web browsers to help scrape images found on web searches. This should only be used for edu…

Console based audio-file metadata tagger that uses the Discogs.com API v2 (JSON based). Relies on the Mutagen and discogs-client libraries. Currently supports FLAC and MP3 file types.

Note that this utility is no longer maintained. discogstagger is a console based audio meta-data tagger for FLAC, Ogg and MP3 audio files. Album, artist and track data profile is retrieved via the di…

Commons code used by the Data Catalog connectors, and links for the connectors sample code.

Each subfolder contains a Python package. Please check components' README files for details. The following components are available in this repo: The following sample codes are available:

Goblyn is a Python tool focused to enumeration and capture of website files metadata.

Goblyn is a tool focused to enumeration and capture of website files metadata. Goblyn will search for active directories in the website and so enumerate the files, if it find some file it will get th…

Common interface for data container classes

Currently supported types are: The wrapped object is modified in-place: The following adapters are included by default: Stores the currently registered adapter classes. The returned value is taken fr…

A library for reading and, in the future, writing audio metadata. https://audio-metadata.readthedocs.io/

Clean and understandable code, nice API, and good UX (user experience) are the focal points of audio-metadata. One or more of these things I feel are lacking from already existing alternatives enough…