An Entirely New Data Infrastructure
After an orientation phase, in which BUX listed the pros and cons of the various cloud providers, BUX decided to transfer the entire data stack to Google Cloud Platform. The flagship BUX Zero was already running on Google Cloud Platform, and they were very satisfied and familiar with it. Moreover, the cultural fit of Google - in which open source and freedom of choice are of paramount importance - is also best in line with BUX's vision. All in all, it was therefore a logical choice to move the Business Intelligence environment to Google's Cloud Platform.
The choice for the data warehouse fell on Snowflake. BigQuery might seem more logical - since it is a product of Google itself - but turned out not to be entirely suitable for BUX's use case.
BUX engaged Xebia to help with the transfer of data from the various data sources. Xebia laid the foundation for a good infrastructure for the new data stack. This was a fairly complex project, in which the entire network first had to be devised and designed. Then the application landscape was built with Kubernetes running AirFlow (a scheduler for data pipelines). Everything is connected, so that BUX only has to write the data pipelines.
It is quite unique that so much effort is put into modernizing the infrastructure where a data project is fundamentally involved. But for a modern company operating on a scale like BUX, it was essential to get everything right, from the ground up.
In the meantime, BUX has hired two data engineers and Xebia has transferred the knowledge to BUX, so that they are in control themselves. All the code that Xebia has written is now completely mastered by the engineers.
