Bigdata Libraries

The reference book for these and other Spark related topics is: The following notebooks can be examined individually, although there is a more or less linear 'story' when followed in sequence. By usi…

Feel free to contact me to discuss any issues, questions, or comments. This repository contains a variety of content; some developed by Jose A. Dianes, and some from third-parties. The third-party c…

If you need to generate 10,000 sensors data: In this project, I achieved 4 types of real-time analysis. ####(4) Total number of sensors The result shows console output of Spark Streaming which proces…

Google, Naver multiprocess image crawler (High Quality & Speed & Customizable) Install Chrome pip install -r requirements.txt Write search keywords in keywords.txt Files will be downloaded to…

Would you prefer to connect to a remote UStore server? UStore comes with an Apache Arrow Flight RPC interface! Function calls may look identical, but the underlying implementation can be addressing h…

UKV is more than a database. It is a "build your database" toolkit and an open standard for NoSQL potentially-transactional databases, defining zero-copy binary interfaces for "Create, Read, Update, …