K
Kathleen Martin
Guest
Companies are waking up to data architecture being a companywide matter, not just an issue for the chief data officer. But like anything in IT, it has led to an explosion of hype, IT concepts, acronyms, loose definitions, and confusion.
Data leaders wading through this growing alphabet soup of new IT vocabulary terms, two have emerged to have a polarizing effect: data mesh and data fabric. Each has its merits and reasons why companies are taking a hard look.
While they offer options for companies trying to tame the unruly mess left by data fragmentation and unlock more value from their data sets, they also put data governance at the front and center of their data strategies.
Reframing the data headache
Data fabric is essentially a design concept and technology architecture. Forrester analyst Noel Yuhanna was among the first to define the term in the mid-2000s.
“Data fabric is a design concept and technology architecture geared toward addressing the complexity of data management to operate in any hybrid or fragmented data ecosystem. It emphasizes data automation, a robust metadata foundation, and a flexible technology backbone,” says Jon Teo, data governance domain expert at Informatica.
The primary value of a data fabric for a disparate data ecosystem is that it unifies its representation, management, and data access without having to consolidate the data assets physically. According to Teo, the “beauty” of having a flexible, unified platform is that new or changed data can be easily added or onboarded using a low or no code approach. Essentially, it allows data stewards, engineers, analysts, and scientists to create better data pipelines and oversee them.
While the benefits are clear, practicing it has been a problem. In the past, assembling a data fabric with the full suite of data management capabilities for both on-premises and cloud ecosystems would require multiple vendors' tools. Then, you are saddled with the additional cost and associated risks of stitching these together.
Now, companies like Informatica offer all the pillars needed to establish a data fabric architecture built on AI-powered metadata across end-to-end data management capabilities. They range from data integration to data governance and from data mastering to self-service analytics.
Data mesh takes a different tact to address data fragmentation within the enterprise. Instead of an overarching technology management layer, it makes it a human question by creating distributed teams to manage their data domains as they see fit.
“Data mesh focuses on organizational change – enabling domain teams to own the delivery of data products with the understanding that the domain teams are closer to their data and thus understand their data better,” says Teo.
The idea is that these localized data “product teams” (composed of various roles such as business data stewards, analysts, and engineers) will know their domain data better. Combining or “meshing” their management capabilities will help companies quickly gain insights into complex questions and scale analytic capabilities across the organization.
Continue reading: https://www.cdotrends.com/story/16560/how-modernizing-data-governance-speeds-data-mesh-and-data-fabric-adoption
Data leaders wading through this growing alphabet soup of new IT vocabulary terms, two have emerged to have a polarizing effect: data mesh and data fabric. Each has its merits and reasons why companies are taking a hard look.
While they offer options for companies trying to tame the unruly mess left by data fragmentation and unlock more value from their data sets, they also put data governance at the front and center of their data strategies.
Reframing the data headache
Data fabric is essentially a design concept and technology architecture. Forrester analyst Noel Yuhanna was among the first to define the term in the mid-2000s.
“Data fabric is a design concept and technology architecture geared toward addressing the complexity of data management to operate in any hybrid or fragmented data ecosystem. It emphasizes data automation, a robust metadata foundation, and a flexible technology backbone,” says Jon Teo, data governance domain expert at Informatica.
The primary value of a data fabric for a disparate data ecosystem is that it unifies its representation, management, and data access without having to consolidate the data assets physically. According to Teo, the “beauty” of having a flexible, unified platform is that new or changed data can be easily added or onboarded using a low or no code approach. Essentially, it allows data stewards, engineers, analysts, and scientists to create better data pipelines and oversee them.
While the benefits are clear, practicing it has been a problem. In the past, assembling a data fabric with the full suite of data management capabilities for both on-premises and cloud ecosystems would require multiple vendors' tools. Then, you are saddled with the additional cost and associated risks of stitching these together.
Now, companies like Informatica offer all the pillars needed to establish a data fabric architecture built on AI-powered metadata across end-to-end data management capabilities. They range from data integration to data governance and from data mastering to self-service analytics.
Data mesh takes a different tact to address data fragmentation within the enterprise. Instead of an overarching technology management layer, it makes it a human question by creating distributed teams to manage their data domains as they see fit.
“Data mesh focuses on organizational change – enabling domain teams to own the delivery of data products with the understanding that the domain teams are closer to their data and thus understand their data better,” says Teo.
The idea is that these localized data “product teams” (composed of various roles such as business data stewards, analysts, and engineers) will know their domain data better. Combining or “meshing” their management capabilities will help companies quickly gain insights into complex questions and scale analytic capabilities across the organization.
Continue reading: https://www.cdotrends.com/story/16560/how-modernizing-data-governance-speeds-data-mesh-and-data-fabric-adoption
