<h3><strong>Summary</strong></h3><p>In this podcast episode, Vaughn and Mark Planagumà discuss various aspects of data strategies and the implementation of Data Mesh. Mark shares his background in data engineering and his experience in building data platforms for different companies. They explore the use of Domain-Driven Design in data strategies and the role of contracts in data architecture. Mark explains the concept of Data Mesh and how it shifts the focus from centralized data warehouses to domain-driven, decentralized data products. They also discuss the implementation of data governance and automation, the influence of operational software architectures on data strategies, and the design of a semantic layer in a Data Mesh. The conversation explores the maturity in operational and analytical architecture, the influence of Domain-Driven Design on Data Mesh, the tooling required for Data Mesh, the future of analytics, challenges with AI and metadata, and where to learn more about Data Mesh.</p><p><br></p><h3><strong>Takeaways</strong></h3><ul><li>Domain-Driven Design can be applied to data strategies to organize data by domains and enable domain owners to take responsibility for their data.</li><li>Data Mesh is a paradigm shift that emphasizes decentralized, domain-driven data products instead of centralized data warehouses.</li><li>Contracts play a crucial role in data architecture by defining the metadata and governance rules for data products.</li><li>Implementing data governance and automation can help ensure the discoverability, accessibility, and reusability of data in a data mesh.</li><li>Organizational structure needs to align with the principles of Data Mesh, with domain-driven teams owning and managing their data.</li><li>A semantic layer in a Data Mesh helps organize and aggregate data products by domains, making it easier to discover and consume data.</li><li>Operational software architectures can influence data strategies by providing the infrastructure and tooling for data products in a Data Mesh. Data is typically behind operational and application maturity, but Data Mesh is emerging to bridge the gap.</li><li>Domain-Driven Design plays a significant role in shaping Data Mesh and enabling interoperability between operational and analytical systems.</li><li>Existing tools like lake houses and data warehousing can be leveraged to support Data Mesh, focusing on creating interoperable data products.</li><li>The future of analytics lies in improving data quality, metadata management, and leveraging AI to interact with data in a more natural and business-focused way.</li></ul><h3><br></h3><h3><strong>Chapters</strong></h3><p><em>Please note these are approximate locations! We are trying new tools and hope you find this helpful.</em></p><p>00:00 Introduction and Background</p><p>05:32 Using Domain-Driven Design with Data Strategies</p><p>09:20 Understanding Data Mesh</p><p>11:18 The Role of Contracts in Data Architecture</p><p>28:21 Influencing Organizational Structure for Data Mesh</p><p>34:00 Semantic Layer Design in Data Mesh</p><p>37:36 Impact of Operational Software Architectures on Data Strategies</p><p>37:52 Maturity in Operational and Analytical Architecture</p><p>42:30 Domain-Driven Design and Data Mesh</p><p>47:08 Tooling for Data Mesh</p><p>53:29 The Future of Analytics</p><p>01:01:08 Challenges with AI and Metadata</p><p>01:09:36 Learning More about Data Mesh</p><br><p><br></p><p>Marc Planagumà, is a native of Olot (Catalonia) with degrees in Telecommunications from UPC. He is a prominent figure in data engineering and governance.&nbsp;</p><p>He serves as the Data Platform &amp; Governance Director at Adevinta Spain, where he has spearheaded the development and implementation of Lakehouse architecture and Data Mesh paradigm, focusing on scalability, autonomy, and effective governance by design.</p><br /><hr><p style='color:grey; font-size:0.75em;'> Hosted on Acast. See <a style='color:grey;' target='_blank' rel='noopener noreferrer' href='https://acast.com/privacy'>acast.com/privacy</a> for more information.</p>

Add Dot

Vaughn Vernon

Decentralizing Data: Navigating the Shift to Data Mesh

APR 24, 202475 MIN
Add Dot

Decentralizing Data: Navigating the Shift to Data Mesh

APR 24, 202475 MIN

Description

<h3><strong>Summary</strong></h3><p>In this podcast episode, Vaughn and Mark Planagumà discuss various aspects of data strategies and the implementation of Data Mesh. Mark shares his background in data engineering and his experience in building data platforms for different companies. They explore the use of Domain-Driven Design in data strategies and the role of contracts in data architecture. Mark explains the concept of Data Mesh and how it shifts the focus from centralized data warehouses to domain-driven, decentralized data products. They also discuss the implementation of data governance and automation, the influence of operational software architectures on data strategies, and the design of a semantic layer in a Data Mesh. The conversation explores the maturity in operational and analytical architecture, the influence of Domain-Driven Design on Data Mesh, the tooling required for Data Mesh, the future of analytics, challenges with AI and metadata, and where to learn more about Data Mesh.</p><p><br></p><h3><strong>Takeaways</strong></h3><ul><li>Domain-Driven Design can be applied to data strategies to organize data by domains and enable domain owners to take responsibility for their data.</li><li>Data Mesh is a paradigm shift that emphasizes decentralized, domain-driven data products instead of centralized data warehouses.</li><li>Contracts play a crucial role in data architecture by defining the metadata and governance rules for data products.</li><li>Implementing data governance and automation can help ensure the discoverability, accessibility, and reusability of data in a data mesh.</li><li>Organizational structure needs to align with the principles of Data Mesh, with domain-driven teams owning and managing their data.</li><li>A semantic layer in a Data Mesh helps organize and aggregate data products by domains, making it easier to discover and consume data.</li><li>Operational software architectures can influence data strategies by providing the infrastructure and tooling for data products in a Data Mesh. Data is typically behind operational and application maturity, but Data Mesh is emerging to bridge the gap.</li><li>Domain-Driven Design plays a significant role in shaping Data Mesh and enabling interoperability between operational and analytical systems.</li><li>Existing tools like lake houses and data warehousing can be leveraged to support Data Mesh, focusing on creating interoperable data products.</li><li>The future of analytics lies in improving data quality, metadata management, and leveraging AI to interact with data in a more natural and business-focused way.</li></ul><h3><br></h3><h3><strong>Chapters</strong></h3><p><em>Please note these are approximate locations! We are trying new tools and hope you find this helpful.</em></p><p>00:00 Introduction and Background</p><p>05:32 Using Domain-Driven Design with Data Strategies</p><p>09:20 Understanding Data Mesh</p><p>11:18 The Role of Contracts in Data Architecture</p><p>28:21 Influencing Organizational Structure for Data Mesh</p><p>34:00 Semantic Layer Design in Data Mesh</p><p>37:36 Impact of Operational Software Architectures on Data Strategies</p><p>37:52 Maturity in Operational and Analytical Architecture</p><p>42:30 Domain-Driven Design and Data Mesh</p><p>47:08 Tooling for Data Mesh</p><p>53:29 The Future of Analytics</p><p>01:01:08 Challenges with AI and Metadata</p><p>01:09:36 Learning More about Data Mesh</p><br><p><br></p><p>Marc Planagumà, is a native of Olot (Catalonia) with degrees in Telecommunications from UPC. He is a prominent figure in data engineering and governance.&nbsp;</p><p>He serves as the Data Platform &amp; Governance Director at Adevinta Spain, where he has spearheaded the development and implementation of Lakehouse architecture and Data Mesh paradigm, focusing on scalability, autonomy, and effective governance by design.</p><br /><hr><p style='color:grey; font-size:0.75em;'> Hosted on Acast. See <a style='color:grey;' target='_blank' rel='noopener noreferrer' href='https://acast.com/privacy'>acast.com/privacy</a> for more information.</p>