There are many ways to integrate Apache NiFi and Apache Spark.
We can call Apache Spark Streaming via S2S (Apache NiFi’s Site to Site) or Kafka. If you want to execute a regular Apache Spark job, you can do that via Apache Livy which is included in HDP 2.6+. This is how Apache Zeppelin integrates with Apache Spark, so it’s secure and a reasonable approach. https://goo.gl/DfGFbg #DataIntegration #ML
ICYMI: During the Fall of 2017, we conducted a microservices survey with our Red Hat Middleware and Red Hat OpenShift customers. Here are eight interesting trends discerned by the results:
I. Microservices Are Being Used to Re-Architect Existing Applications as Much as for Brand New Projects
There seems to be a strong emphasis in the market by technology vendors for positioning microservices as being only for new projects. However, our survey reveals that organizations are also using microservices to re-architect existing and legacy applications. https://goo.gl/RL8sXe #DataIntegration #ML
