Ingesting Blockchain Data From btc.com and blockchain.com(.info).
Blockchain exchanges contain a large amount of data that you need to ingest, process, store, and analyze if you wish to make proper trades and find the right time to buy and sell various currencies. Bitcoin, being the first and most valuable, is a currency I wish to trash. Using two sites that provide great APIs for data: btc.com and blockchain.com. They provide easy to ingest and fast REST APIs returning clean JSON. With this data, sometimes like in Blockchain Blocks for the current data in the format of multiple JSON records, I want to split that, which is easy with Apache NiFi. Once there, I use the prebuilt JSON schema (I used InferAvroSchema to derive this). I can now run live queries on my blockchain data as it enters the system before I put it into Apache Hive for permanent storage.
API Calls https://goo.gl/Rvomc1 #DataIntegration #ML
