Use Case

Financial data warehouse on Microsoft Azure and PowerBI

The Challenge

A strong provider of financial services in the Netherlands, required the migration of on-premise data warehouses to Microsoft Azure Cloud. The architecture should be able to extract data from different sources and types, archive the files in a reliable storage, and process them up to a data warehouse to be consumed by MS Power BI where we built reports and Dashboards that internal and external clients will consume as well as be able to self-service the data. The information for each client had to be available based on the SLAs defined.

The solution:

Adopting an Agile framework, we designed the architecture with the best market practices and the possibility of scaling the solution to greater levels. The infrastructure was provided by Terraform and Microsoft Bicep (IAAC). This solution and architecture delivered a robust environment with a disaster recovery process.

We used Azure Data Factory to integrate and orchestrate the different sources. The Reports were built on Databricks and SQL Server. For archiving, we used Azure Data Lake Gen2.
The project technologies were Scrum, Terraform, Microsoft Bicep, Azure Devops, Azure Data Factory, Azure Data Lake Gen2, Azure Databricks, MS Power BI, SSIS, SSRS, MSSQL Server On-Premise and cloud, Power Automate, PySpark.

Conclusion:

The successful migration of on-premise data warehouses to Microsoft Azure Cloud enabled our client to leverage a scalable, robust, and disaster-resilient architecture. By integrating various advanced technologies and adhering to best market practices, seamless data extraction, processing and reporting were ensured. This transformation not only enhanced data accessibility and reliability but also empowered both internal and external clients with self-service capabilities through MS Power BI. The project is a testament to our commitment to delivering innovative and efficient solutions in the financial services sector.