Data Federation Between SAP HANA Cloud and Amazon Redshift Through SAP HANA smart data integration

Regardless of where your data is, there is a method to move/federate your data into SAP HANA. Our Customer Innovation team has compiled the series of blog posts to provide step-by-step instructions for federating your data in SAP HANA.

For the blog post of data federation between SAP HANA Cloud and Azure Storage, you can find it here:

Part 3: Data Federation Between Azure Storage and SAP HANA Cloud Through Azure HDInsight And SAP HANA Smart Data Integration Hive Adapter

In this installment, we will show you how to create a data federation between Amazon  Redshift and SAP HANA Cloud through SAP HANA Smart Data Integration Camel JDBC Adapter.

System Architecture Diagram:

1. Amazon Redshift instance and the network has been configured for external access.
2. SAP HANA Cloud instance
3. SAP HANA Smart Data Integration DP Agent installed

Here are the main steps to set up this data flow:

Steps for Amazon Redshift:

Get JDBC URL from Amazon Redshift instance service page:

Download Amazon Redshift JDBC driver from this link https://docs.aws.amazon.com/redshift/latest/mgmt/configure-jdbc-connection.html#download-jdbc-driver.

Steps for SAP HANA Smart Data Integration DP Agent:

Copy Amazon Redshift JDBC driver into file folder <DPA_install_dir>\camel\lib on SAP Smart Data Integration DP Agent server

use DP Agent Configuration Tools to register Camel JDBC adapter in SAP HANA Cloud

A detailed Camel JDBC adapter configure guide can be found here:

https://help.sap.com/viewer/7952ef28a6914997abc01745fef1b607/2.0_SPS05/en-US/598cdd48941a41128751892fe68393f4.html

Steps for SAP HANA Cloud:

Create remote source in SAP HANA Cloud Cockpit page

Configure the remote source:

Pick CamelJdbcAdapter from the DP agent you installed before

Fill JDBC Driver class as com.amazon.redshift.jdbc42.Driver

Fill JDBC URL which got from previous step

Explore Amazon Redshift schema and create virtual objects

Now the virtual table is available under your SAP HANA schema. This virtual table can be queried directly or it can be used in: view/calculation view, among other places. The query against this virtual table will be pushed down to Amazon Redshift through the SAP HANA Smart Data Integration DP Agent and it also brings the query result back to SAP HANA Cloud for further use.

In conclusion, there are two advantages to creating a data federation. The first is that it does not replicate data, freeing up resources and time and the second is that a data federation centralizes your data, which reduces the workload on your systems and allows for greater analysis.

Thanks for reading. If you have any questions, please reach out to ci_sce@sap.com.