Skip to Content
Technical Articles

Data Federation Between SAP HANA Cloud and Amazon Web Services Redshift Through SAP HANA smart data integration

Regardless of where your data is, there is a method to move/federate your data into SAP HANA. Our Customer Innovation team has compiled the series of blog posts to provide step-by-step instructions for federating your data in SAP HANA.

For the blog post of data federation between SAP HANA Cloud and Azure Storage, you can find it here:

Part 3: Data Federation Between Azure Storage and SAP HANA Cloud Through Azure HDInsight And SAP HANA Smart Data Integration Hive Adapter

In this installment, we will show you how to create a data federation between Amazon Web Services (AWS) Redshift and SAP HANA Cloud through SAP HANA smart data integration Camel JDBC Adapter. When researching solutions within SAP channels, we found that there was no standard process for addressing this, so we wrote this article in hopes that people in a similar situation will find it useful.

System Architecture Diagram:

Preconditions:

  1. AWS Redshift instance and the network has been configured for external access.
  2. SAP HANA Cloud instance
  3. SAP HANA smart data integration DPA installed

 

Here are the main steps to set up this data flow:

Steps for Redshift:

Get JDBC URL from AWS Redshift instance service page:

Download AWS Redshift JDBC driver from this link https://docs.aws.amazon.com/redshift/latest/mgmt/configure-jdbc-connection.html#download-jdbc-driver.

Steps for SAP HANA smart data integration DPA:

Copy Redshift JDBC driver into file folder <DPA_install_dir>\camel\lib on SAP smart data integration DPA server

use DP Agent Configuration Tools to register Camel JDBC adapter in SAP HANA Cloud

A detailed Camel JDBC adapter configure guide can be found here:

https://help.sap.com/viewer/7952ef28a6914997abc01745fef1b607/2.0_SPS05/en-US/598cdd48941a41128751892fe68393f4.html

Steps for SAP HANA Cloud:

Create remote source in SAP HANA Cloud Cockpit page

Configure the remote source:

Pick CamelJdbcAdapter from the DP agent you installed before

Fill JDBC Driver class as com.amazon.redshift.jdbc42.Driver

Fill JDBC URL which got from previous step

Explore Redshift schema and create virtual objects

 

Now the virtual table is available under your SAP HANA schema. This virtual table can be queried directly or it can be used in: view/calculation view, among other places. The query against this virtual table will be pushed down to AWS Redshift through the SAP HANA smart data integration DP Agent and it also brings the query result back to SAP HANA Cloud for further use.

In conclusion, there are two advantages to creating a data federation. The first is that it does not replicate data, freeing up resources and time and the second is that a data federation centralizes your data, which reduces the workload on your systems and allows for greater analysis.

Thanks for reading. If you have any questions, please reach out to ci_sce@sap.com.

Be the first to leave a comment
You must be Logged on to comment or reply to a post.