Open Source Summit North America 2023

Most of the first two decades of this century marked the rise of the open source big data processing systems - bringing a huge relief from vendor lock-ins and sometimes extortionate licensing terms experience in the earlier 3 decades. However, having lived through the initial bonhomie of these systems, large data organisations have got themselves into a complex spaghetti of numerous independent open source components that need a village to manage and slows pace of delivery of new features. To address this, new approaches like data mesh, open standards and open data APIs are emerging - collectively referred to as the open data ecosystem. In this talk, Ranadip will explore how the evolution of this data ecosystem can be leveraged to break the complex spaghetti that is now threatening to stifle the pace of turning data into a revenue-earning asset. In particular, this session will uncover * The underlying principles involved returning value out of data, * How complex management in operating a mish-mash of "open" systems reduces velocity of feature delivery, * Benefits of the Open Data Ecosystem in reducing friction and removing bottlenecks * Further optimisations provided by cloud providers