[ad_1]
Zhamak Dehghani, known for popularizing the concept of data meshes, announced the formation of Nextdata earlier this month. The new organization will develop software designed to help customers implement “data product containers” that live in this data mesh environment.
Dehghani is the Director of Next Tech Incubation at Thoughtworks North America, where he first came up with the idea for Data Mesh. The core idea is based on the knowledge that in today’s large, fragmented data environments, it is impossible to centralize data top-down compared to older data warehouses. Instead, data remains distributed, in silos, and never fully integrated. Instead of that old-style data management, a more agile and modern concept is needed, and that’s where Dehghani’s data and his mesh ideas come into play.
“The main reason the promised value from data has not been realized is that today’s ways of managing data for analytics, AI and machine learning were conceived in a paradigm where data is treated like oil. It is extracted and sent to storage facilities, processed and consumed as a valuable resource pumped through pipelines,” Dehghani wrote in a Medium article. “This creates a complex set of problems. Fragile data pipelines are broken. Processes are fragmented. We spend time on low-value processes, primarily moving data between systems, without giving it due consideration.”
As I wrote earlier, Dehghani’s key insight was that data transformations cannot be built into the data by engineers, but should act like filters applied to common data sets. Take ownership of data, scale it, comply with governance policies, and disrupt the world of data pipelines by empowering teams of developers to access distributed data in a self-service manner using federated governance You can build compelling products that don’t perpetuate .
The concept of a data mesh has gained widespread popularity over the last few years as a potentially valuable pattern to help manage and exploit big data. During that time his Dehghani, who authored his O’Reilly book on data meshes, became a very popular speaker. She left her Thoughtworks in her 2022 and started work on her startup Stealth.
According to Dehghani, Nextdata will build tools to help users realize the full potential of data meshes. “Data Mesh has transformed our mental model of what a thriving data ecosystem looks like,” she wrote in her Medium post. “However, our tools and techniques leave a significant capability gap that makes data mesh implementation difficult, expensive, and full of compromises. We are building Nextdata for
Mr. Deghani in 2022 Data Nami Person to Watch joins Nextdata with three big data veterans, including founding CTO Raghotham Murthy, founding head of product Sina Jahan, and founding lead engineer Dan Siwiec. Murthy is a member of the Apache Hive PMC and previously he was a Cloudera company. Jahan is from ThoughtWorks where he was the head of the Data Mesh practice. Siwiec has served as Director of Software Engineering at Slalom and holds a position as Principal His Architect at his Kambr, which is owned by European travel giant Amadeus.
“Nextdata OS is a data meshing toolset designed for the large-scale distribution of analytical data within and across organizations,” Deghani wrote in her Medium article. “We are introducing a new unit of data value, the Data Product Container, designed to be shared and used responsibly and at scale. We are reimagining the new developer and user experience around
We reached out to Dehghani and hope to catch up with her soon to hear more about her new venture.
Related products:
Meet Zhamak Dehghani, Notable 2022 Datanami Person
data mesh vs.Data Fabric: Understanding the Difference
Data Mesh: What’s Good for Your Business?
[ad_2]
Source link
