I recently wrote about the importance of data pipelines and the role they play in transporting data between the stages of data processing and analytics. Healthy data pipelines are necessary to ensure data is integrated and processed in the sequence required to generate business intelligence. The concept of the data pipeline is nothing new of course, but it is becoming increasingly important as organizations adapt data management processes to be more data driven.
Read More
Topics:
business intelligence,
Analytics,
Data Governance,
Data Integration,
Data,
Digital Technology,
Digital transformation,
data lakes,
data operations,
AI & Machine Learning,
digital business,
data platforms,
Analytics & Data,
Streaming Data & Events
Data mesh is the latest trend to grip the data and analytics sector. The term has been rapidly adopted by numerous vendors — as well as a growing number of organizations —as a means of embracing distributed data processing. Understanding and adopting data mesh remains a challenge, however. Data mesh is not a product that can be acquired, or even a technical architecture that can be built. It is an organizational and cultural approach to data ownership, access and governance. Adopting data mesh...
Read More
Topics:
business intelligence,
Analytics,
Data Governance,
Data Integration,
Data,
Digital Technology,
Digital transformation,
data lakes,
data operations,
digital business,
data platforms,
Analytics & Data,
Streaming Data & Events
Despite widespread and increasing use of the cloud for data and analytics workloads, it has become clear in recent years that, for most organizations, a proportion of data-processing workloads will remain on-premises in centralized data centers or distributed-edge processing infrastructure. As we recently noted, as compute and storage are distributed across a hybrid and multi-cloud architecture, so, too, is the data it stores and relies upon. This presents challenges for organizations to...
Read More
Topics:
business intelligence,
Analytics,
Data Governance,
Data,
data operations,
AI & Machine Learning,
data platforms
As businesses become more data-driven, they are increasingly dependent on the quality of their data and the reliability of their data pipelines. Making decisions based on data does not guarantee success, especially if the business cannot ensure that the data is accurate and trustworthy. While there is potential value in capturing all data — good or bad — making decisions based on low-quality data may do more harm than good.
Read More
Topics:
Data Governance,
Data Integration,
Data,
Digital Technology,
data lakes,
data operations,
Analytics & Data
I recently described the emergence of hydroanalytic data platforms, outlining how the processes involved in generating energy from a lake or reservoir were analogous to those required to generate intelligence from a data lake. I explained how structured data processing and analytics acceleration capabilities are the equivalent of turbines, generators and transformers in a hydroelectric power station. While these capabilities are more typically associated with data warehousing, they are now...
Read More
Topics:
Analytics,
Data Governance,
Data Integration,
Data,
data lakes,
data operations,
AI & Machine Learning,
data platforms,
Streaming Data & Events
As I stated when joining Ventana Research, the socioeconomic impacts of the pandemic and its aftereffects have highlighted more than ever the differences between organizations that can turn data into insights and are agile enough to act upon it and those that are incapable of seeing or responding to the need for change. Data-driven organizations stand to gain competitive advantage, responding faster to worker and customer demands for more innovative, data-rich applications and personalized...
Read More
Topics:
business intelligence,
Analytics,
Data Integration,
Data,
data lakes,
data operations,
AI & Machine Learning,
data platforms,
Streaming Data & Events
Ventana Research recently announced its 2022 Market Agenda for Data, continuing the guidance we have offered for nearly two decades to help organizations derive optimal value and improve business outcomes.
Read More
Topics:
Data Governance,
Data Integration,
Data,
data lakes,
data operations,
data platforms,
Streaming Data & Events
Data lakes have enormous potential as a source of business intelligence. However, many early adopters of data lakes have found that simply storing large amounts of data in a data lake environment is not enough to generate business intelligence from that data. Similarly, lakes and reservoirs have enormous potential as sources of energy. However, simply storing large amounts of water in a lake is not enough to generate energy from that water. A hydroelectric power station is required to harness...
Read More
Topics:
Analytics,
Business Intelligence,
Cloud Computing,
Data Governance,
Data Integration,
Data,
Digital Technology,
data lakes,
data operations,
AI & Machine Learning,
data platforms
As I noted when joining Ventana Research, the range of options faced by organizations in relation to data processing and analytics can be bewildering. When it comes to data platforms, however, there is one fundamental consideration that comes before all others: Is the workload primarily operational or analytic? Although most database products can be used for operational or analytic workloads, the market has been segmented between products targeting operational workloads, and those targeting...
Read More
Topics:
Analytics,
Business Intelligence,
Data,
data lakes,
data operations,
AI & Machine Learning,
data platforms
It has been clear for some time that future enterprise IT architecture will span multiple cloud providers as well as on-premises data centers. As Ventana Research noted in the market perspective on data architectures, the rapid adoption of cloud computing has fragmented where data is accessed or consolidated. We are already seeing that almost one-half (49%) of respondents to Ventana Research’s Analytics and Data Benchmark Research are using cloud computing for analytics and data, of which 42%...
Read More
Topics:
Data,
data lakes,
data operations,
data platforms