SAP Data Replication
Drain on Resources
GWT’s SAP data didn’t always flow into the analyt
A State-of-the-Art Approach: Three Phases
Phase One: Moving to State-of-the-Art
After a detailed and extensive vetting and testing process GWT decided on two new state-of-the-art technologies to better handle increasing data volumes on the target system. With its ability to handle massive data queries, Actian Vector (formerly known as VectorWise) was the chosen database for analytics and with its ability to handle massive data volumes while having little to no impact on the source system, HVR was chosen for real-time data replication.
But problems remained:
- BODS bulk ETL extracts still had to be used to extract data from critical SAP cluster and pool tables because HVR did not yet support these complicated, compacted SAP tables. This continued to cause a heavy load on the source when extracting these tables.
- BODS bulk ETL missed data, resulting in data quality issues.
Phase Two: Here Comes the Cloud
While the analytics platform performed much better than the previous incarnation it still required resources to manage and scale. A hosted cloud service, Amazon (AWS) Redshift, was chosen as a replacement because it could handle massive data queries.
Since HVR supports the latest in cloud technologies it was able to help GWT expedite the testing of several cloud options. In addition to its ability to move ever-increasing volumes of data in real-time, HVR was selected for the following reasons:
However, there was still that one lingering issue clogging up the data flow: the BODS ETS process still caused a heavy load on the source and would often miss data putting some of the analytics into question.
Phase Three: What it Flows Like Today
Several years ago when HVR first started support SAP clustered and pool tables GWT was among the first to adopt this unique capability. This greatly simplified the data flow and elimi
Interested in learning more about the benefits of log-based CDC for moving data out of SAP? Contact us for more information, we are happy to discuss your use case and show you a demo.