Matt Aslett's Analyst Perspectives

Astronomer’s Cloud-Based Data Orchestration Brings Efficiency

Posted by Matt Aslett on Sep 29, 2022 3:00:00 AM

I have recently written about the organizational and cultural aspects of being data-driven, and the potential advantages data-driven organizations stand to gain by responding faster to worker and customer demands for more innovative, data-rich applications and personalized experiences. I have also explained that data-driven processes require more agile, continuous data processing, with an increased focus on extract, load and transform processes — as well as change data capture and automation and orchestration — as part of a DataOps approach to data management. Safeguarding the health of data pipelines is fundamental to ensuring data is integrated and processed in the sequence required to generate business intelligence. The significance of these data pipelines to delivering data-driven business strategies has led to the emergence of vendors, such as Astronomer, focused on enabling organizations to orchestrate data engineering pipelines and workflows.

Read More

Topics: Cloud Computing, Data Management, Data, data operations, Analytics & Data

The Data Catalog is Indispensable for Good Data Governance

Posted by Matt Aslett on Sep 21, 2022 3:15:00 AM

The data catalog has become an integral component of organizational data strategies over the past decade, serving as a conduit for good data governance and facilitating self-service analytics initiatives. The data catalog has become so important, in fact, that it is easy to forget that just 10 years ago it did not exist in terms of a standalone product category. Metadata-based data management functionality has had a role to play within products for data governance and business intelligence for much longer than that, of course, but the emergence of the data catalog as a product category provided a platform for metadata-based data inventory and discovery that could span an entire organization, serving multiple departments, use cases and initiatives.

Read More

Topics: business intelligence, Data Governance, Data Management, Data, data operations, Analytics & Data

Ascend.io Automates Data Engineering

Posted by Matt Aslett on Aug 9, 2022 12:25:00 PM

I have recently written about the importance of healthy data pipelines to ensure data is integrated and processed in the sequence required to generate business intelligence, and the need for data pipelines to be agile in the context of real-time data processing requirements. Data engineers, who are responsible for monitoring, managing and maintaining data pipelines, are under increasing pressure to deliver high-performance and flexible data integration and processing pipelines that are capable of handling the rising volume and frequency of data. Automation is a potential solution to this challenge, and several vendors, such as Ascend.io, have emerged in recent years to reduce the manual effort involved in data engineering.

Read More

Topics: Big Data, Cloud Computing, Data Management, Data, data operations

Content not found