Redesign Legacy Application with all cloud-native capabilities
Challenge:
A Customer with huge datasets in Amazon RDS wanted to use the same datasets for reporting purposes but to build a single report it was taking more than 2hrs and they wanted multiple reports with an option to change the filters in runtime.
Our Solution:
Migrated the data from Amazon RDS to GCP BigQuery. Reduced reporting time from 2hrs to 15 secs with near real-time data with a lag of 15 minutes.
Steps Followed:
Assessment
Created Script for Schema Creation
Created Script for One-time migration
Created Airflow DAGs for Change Data Capture
Created Dashboards in Looker Studio (earlier Google Data Studio)
Steps Followed:
Assessment
Created Script for Schema Creation
Created Script for One-time migration
Created Airflow DAGs for Change Data Capture
Created Dashboards in Looker Studio (earlier Google Data Studio)