Bigdata Libraries

5 Components & Libraries

Sortby

Bigdata Libraries

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

The reference book for these and other Spark related topics is: The following notebooks can be examined individually, although there is a more or less linear 'story' when followed in sequence. By usi…

Google, Naver multiprocess image web crawler (Selenium)

Google, Naver multiprocess image crawler (High Quality & Speed & Customizable) Install Chrome pip install -r requirements.txt Write search keywords in keywords.txt Files will be downloaded to…

Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️

Would you prefer to connect to a remote UStore server? UStore comes with an Apache Arrow Flight RPC interface! Function calls may look identical, but the underlying implementation can be addressing h…

Replacing MongoDB, Neo4J, and Elastic with 1 transactional database. Features: zero-copy semantics, swappable backends, bindings for C, C++, Python, Java, GoLang

UKV is more than a database. It is a "build your database" toolkit and an open standard for NoSQL potentially-transactional databases, defining zero-copy binary interfaces for "Create, Read, Update, …

Spark-and-Kafka_IoT-Data-Processing-and-Analytics

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

If you need to generate 10,000 sensors data: In this project, I achieved 4 types of real-time analysis. ####(4) Total number of sensors The result shows console output of Spark Streaming which proces…

Related tags