Day: June 13, 2018

The world of enterprise and application architecture is growing increasingly complex, and organizations need a solution that simplifies their landscape while ensuring high levels of data security and governance. To become a successful digital business, you need to select a data and application integration strategy that enables you to unify all your company’s data assets and analyze them in the context of your businesses bigger picture.

Data is the currency of digital transformation, and data-driven application integration is the future of enterprise architecture. Organizations are re-architecting and re-imagining their integration strategy with a one-to-many hub model that places the data you care about – Virtual Data Resources – at the center. https://goo.gl/BSnpfz #DataIntegration #ML

1.0 What Is RAML?

RAML is a Rest API Modeling Language and it is based on YAML for describing your API’s. It is basically used to describe your API, which can be easily readable by humans and computers. It basically focuses on describing your API resources, methods, parameters, media type etc.

2.0 What Is ResourceTypes?

ResourceTypes is like resource in that it can specify the descriptions, methods, and its parameters. Resource that uses resourceTypes can inherit its nodes. ResourceTypes can use and inherit from other resourceTypes. https://goo.gl/eKrTXt #DataIntegration #ML

ICYDK: In this article, we will learn how to customize, build, and deploy a Kafka Connect connector in Landoop’s open-source UI tools. Landoop provides an Apache Kafka docker image for developers, and it comes with a number of source and sink connectors to a wide variety of data sources and sinks. FileStreamSourceConnector is a simple file connector that continuously tails a local file and publishes each line into the configured Kafka topic. Although this connector is not meant for production use, owing to its simplicity, we’ll use it to demonstrate how to customize an open source connector to meet our particular needs, build it, deploy it in Landoop’s docker image and make use of it.

Need for Customization

The FileStreamSourceConnector does not include a key in the message that it publishes to the Kafka topic. In the absence of key, lines are sent to multiple partitions of the Kafka topic with round-robin strategy. A relevant code snippet from the FileStreamSourceConnector source code is shown below. https://goo.gl/S7U2do #DataIntegration #ML