Migrating from On-Premise Data Warehouse to Cloud: Challenges, Architecture and Use Case

A multinational provider of Digital, IT Services and Solutions with over 20,000 employees, headquartered in California, USA, were accessing their data from an on-premise data warehouse to generate Business Intelligence (BI) reports. 

Considering the advantages of a cloud-based data warehouse, the company wanted to move their on-premise data warehouse to a modern cloud-based data warehouse. Data Semantics advised the company to choose Microsoft Azure Data Warehouse for its benefits and ease-of-migration. 

Click here to get more info about: power bi pricing

Benefits of migrating to Cloud (Microsoft Azure Data Warehouse): 

    Improved IT resource management 
    Better mobility and reduced dependency on premises 
    Modern technology and constantly updated ecosystem 
    Decreased IT expenditure in maintaining legacy systems 


Although the above benefits are more generic in nature, the important reasons to migrate to Cloud are the benefits of moving to an MPP (Massively Parallel Processing) System from an SMP (Symmetrically Parallel) Systems.

Talk to us directly to know more details about the case study
The Problem 

Although migrating to Azure data warehouse cloud is always a better option, Cloud platforms have a new set of limitations and challenges, compared to the existing SQL Server on-premise data warehouse of the company. 

Challenges in migrating to Cloud (Microsoft Azure Data Warehouse): 

    Azure Cloud Platform doesn’t support some table functions, as compared to SQL Server on-premise DW.  
    Azure Cloud Platform doesn’t support some features of stored procedures on SQL Server on–premise DW. 
    The nature of tables is different on Azure DW, as compared to SQL Server on-premise DW. 
    Azure Cloud Platform doesn’t support Synonyms. They need to be converted to physical tables for Azure DW. 
    Limitations on Functions are a major obstacle. 

The Objective 

Migrate about 800 GB of Data from the on-premise SQL Server data warehouse to Azure Cloud Platform within a span of 12 weeks by working around the limitations and challenges, to maximize the benefits of having a cloud-based data warehouse.

For more info visit here: tableau pricing


The Solution 

The Chief Architect at Data Semantics identified that, the existing on-premise data had to be re-engineered for migrating to Cloud (MS Azure Cloud Platform), considering the way the data is handled on legacy systems. 

The legacy on-premise data warehouse functioned in a rather, traditional ecosystem where the lack of APIs was a major challenge. Additionally, it was difficult to spell out rules, sequential activities, and required outcomes for every data migration step due to the existing legacy systems not matching up to Cloud ecosystem and capabilities. 

The Data Semantics team segregated and handled each element of the database manually, in order to facilitate error-free functioning of the data. These DB elements had their own migration challenges, which were worked on individually by the team members. 

Comments

Post a Comment

Popular posts from this blog

How Complicated Data of a Luxury Retail Group of Companies Turned Into Beautifully Visualized Data

Image
The Situation The finance team of a luxury retail group of companies would spend more than 25 days to generate important financial reports that were critical for taking important business decisions. Most of the data to create the financial reports, was collected from Microsoft Dynamics AX 2012 ERP directly. Generating reports after pulling the data from the ERP was quite a tedious task, thus delaying reporting and further delaying important decision-making. Click here to get more info about:  business intelligence dashboard The same situation applied to marketing and sales departments as well. The Problem Taking key business decisions was much slower in the company as a result of redundant investment of time in generating important Business Intelligence reports. The data came from disparate data sources, considering the group of companies had eight independent finance teams. The retail giant’s IT team could facilitate pulling information from mos...
Read more

new blog post

https://www.tripoto.com/trip/the-chatbot-that-does-it-all-performing-multiple-business-operations-with-a-single-chatbot-now-poss-5d8c47aa80261 http://datasemantics.bravesites.com/entries/general/how-a-telecom-giant-used-robotic-process-automatio https://datasemantics.hatenablog.com/entry/2019/09/26/140818 https://app.box.com/notes/530018638472?s=7kpwi8elae81os9veexzjakm4qepwlcp http://www.onfeetnation.com/profiles/blogs/the-chatbot-that-does-it-all-performing-multiple-business-1 https://www.universalhunt.com/articles/the-chatbot-that-does-it-all-performing-multiple-business-operations-with-a-single-chatbot-now-possible/34625 https://www.launchora.com/story/how-a-telecom-giant-used-robotic-process-automatio https://topsitenet.com/article/236435-how-a-telecom-giant-used-robotic-process-automatio/ https://datasemantics.doodlekit.com/blog/entry/5426761/how-a-telecom-giant-used-r...
Read more

new blog post

https://topsitenet.com/article/245044-how-automated-document-classification-helped-save-tons-of-time-and-resources-for/ https://datasemantics.doodlekit.com/blog/entry/5672501/how-automated-document-classification-helped-save-tons-of-time-and-resources-for-an-electronics-giant http://myturnondemand.com/oxwall/blogs/post/380359 https://www.evernote.com/shard/s719/sh/e213ec99-9678-422a-91e7-250b70c65574/84b5628a67cdaf187fe8ee5fb76dc822 https://www.openlearning.com/u/datasemantics/blog/HowAutomatedDocumentClassificationHelpedSaveTonsOfTimeAndResourcesForAnElectronicsGiant/ https://www.launchora.com/story/how-automated-document-classification-helped-save https://www.universalhunt.com/articles/how-automated-document-classification-helped-save-tons-of-time-and-resources-for-an-electronics-giant/36300 https://sites.google.com/view/how-automated-document/home http://whazzup-u.com/profiles/blogs/ho...
Read more