Why have a real-time Data Warehouse?
5 Benefits of Real-Time Data Warehousing
Going from an infrequently updated data warehouse or data mart environment to a near real-time data warehouse has a number of benefits:
1. FASTER DECISIONS: Make decisions quicker based on more current and more accurate, transactionally consistent, data. Why wait till tomorrow to make a decision you can make today – if you have the data that is?
2. IDEAL DATA LOAD: Lower the load on the data source. Many organizations, especially the ones operating 24×7, have a hard time identifying the ideal data load window that is eliminated by low-impact, log-based change data capture (CDC).
3. FASTER RECOVERY: Recover quicker from any data transformation or load issues. If the nightly batch job fails then it may take the next batch window to recover, whereas more frequent updates allow quicker interventions.
4. NO BATCH WINDOWS: Eliminate the batch window that requires the source database and possibly the data warehouse to be dormant during the load so that (temporarily) inconsistent data is not reflected in queries.
5. OPTIMIZATION: Take advantage of the opportunity to make more optimum use of the powerful data warehouse or data mart database by running transformations in the database rather than in a separate run-time environment.
Real-time Data Warehousing in Action
Implementing a near real-time data warehouse is not trivial but has been done many times before. We helped our customer, CACI, implement a real-time data warehouse. CACI provides information solutions and services in support of national security missions and government transformation for Intelligence, Defense, and Federal Civilian customers. CACI came to HVR because CACI wanted to integrate student administration data with government systems and have the ability to provide real-time data integration for CACI and third- party data to a data warehouse.
CACI chose HVR as its data integration solution to exchange data in real-time between its university customers and the government as well as to deliver customer data from OSIRIS and other systems to the data warehouse. HVR now supports all of the database technologies within the CACI environment, including the Oracle system hosting the OSIRIS application and the university data warehouses, which frequently run on MS SQL Server. CACI offers a SaaS version of OSIRIS and HVR enables integration with this version as well.
Using HVR for data integration, CACI has been able to provide high-performing real-time data integration to its customers. HVR’s log-based change data capture functionality eliminates performance impact on the OSIRIS production application. HVR also highly compresses data to minimize latency for data transfer across the network.
Feel free to contact us to discuss what the options may be for your use case.