Arq Libraries

11 Components & Libraries

Sortby

Arq Libraries

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON…

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

For example to trigger installation of GPU version of tensorflow and opencv, use the following pip command: Petastorm supports extensible data codecs. These enable a user to use one of the standard d…

cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes

An attempt is made to ensure that the dataset schemas conform to a common set of design guidelines: Standard types across tables:

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

See Also: repos which contains hundreds more scripts and programs for Cloud, Big Data, SQL, NoSQL, Web and Linux. Hari Sekhon Cloud & Big Data Contractor, United Kingdom List all programs: Run an…

High-performance Async REST API, in Python. FastAPI + GINO + Arq + Uvicorn (w/ Redis and PostgreSQL).

High-performance Async REST API, in Python. FastAPI + GINO + Arq + Uvicorn (powered by Redis & PostgreSQL).

A tool for batch loading data files (json, parquet, csv, tsv) into ElasticSearch

Fully Python async FastAPI project! 🚀

The full stack of this project is composed by: After installing the above, you should be able to run the following: I've seen a lot of projects and tutorials using FastAPI. Which is awesome, and it m…

An extendable async API using FastAPI, Pydantic V2, SQLAlchemy 2.0, PostgreSQL and Redis.

Start by using the template, and naming the repository to what you want. Then clone your created repository (I'm using the base for the example) For database administration using PGAdmin create the f…

Python Client library for interacting with Community, Developer, and Enterprise Editions SonarQube's REST APIs and SonarCloud's REST APIs.

python-sonarqube-api provides a simple interface for clients to interact with SonarQube via the REST API. There are two editions of python-sonarqube-api: The easiest way to install the latest version…

A python example for using OpenCV to identify faces within @britishmuseum images.

This is a very simple example and pulls busts (100 of them) from the British Museum collection and uses them to create image montages. Within the folder are all the files pulled from the example scri…

💫 Deploy SPARQL endpoints from RDFLib Graphs to serve RDF files, machine learning models, or any other logic implemented in Python

You can use wildcard and provide multiple files, for example to serve all turtle, JSON-LD and nquads files in the current folder you could run: Deploy your SPARQL endpoint as a standalone API: TODO: …

Related tags