“The Emergence of DataOps”

(Dan Potter, ATTUNITY, 12 February 2019)

“Enterprises try to integrate data in real time for better business insights. However, by leveraging real-time data integration technologies such as Change Data Capture (CDC) and streaming data pipelines, DataOps is disrupting how data is broadly shared and how it is made available across the enterprise”.

There are three big topics shaping the data landscape in 2019: 1) The rise of DataOps: DataOps will be keystone in optimizing communication, integration and automation of data loads between business analytics consumers and the data/IT teams. The increasing focus on integration and automation leads to the break of silos in IT operations. Enterprises will be able to move data at the speed of change while giving more information on the different source data collected. 2) The cloud re-evolution: this trend is moving fast toward a hybrid and multi-cloud approach. Public clouds are not equal, so organizations will invest in various cloud platforms, according to different business requirements. It will take place the proliferation of infrastructures, databases and analytic tools, offering flexibility to move and use the data. However, enterprises will be faced with the challenge of bringing all the information together for proper analysis. 3) Modern data integration: can automate data pipelines to brace modern analytics platforms, such as data lakes or cloud data warehousing. Data lakes decouple the storage from the compute and provisioning specific data sets, by supporting different analytic use cases. Modern data integration pipelines will support orchestration and automation across the multi-step process of data ingest, transformation and provisioning in order to overcome the complexity. Cloud, data lakes, analytics engines and modern data integration platforms at their service will enable enterprises to analyze data in time so that they can stay relevant and competitive.

Leave a Reply

Your email address will not be published. Required fields are marked *