BEGIN ARTICLE PREVIEW:
Christian Tan, Director of Engineering, SonderIn the light of your experience what are the trends and challenges you’ve witnessed happening in the Big Data space?
One of the major trends we’ve seen is how the migration of operating applications in the public cloud has resulted increasingly in companies opting for their public cloud vendor’s native data services when it comes to Big Data solutions. The major public clouds like AWS, GCP and Azure all have their own offerings when it comes to data storage and data processing platforms that are elbowed out erstwhile dominant proprietary enterprise solutions in the past. The family of cloud service offerings taken as a whole presents a very compelling case and obviates the need to implement the external proprietary solutions.
Another trend that has seemingly gained steam is the emergence of the data lake as a necessary component of any big data strategy. Being able to dump data into a central repository independent of format or source for further processing is the central tenet of a data lake. Increasingly, companies are realizing the benefits of having a searchable catalog of data in the data lake that allows for data discovery and exploration.
END ARTICLE PREVIEW