Data Federation Between SAP Data Warehouse Cloud and Azure Data Explorer

In this installment, we will show you how to create a data federation between SAP Data Warehouse Cloud and Azure Data Explorer through SAP HANA Smart Data Integration (SDI) MssqlLogReaderAdapter.

System Architecture Diagram:

Prerequisites:

1. Azure Data Explorer Cluster and database instance is ready
2. SAP Data Warehouse Cloud instance is ready
3. SAP HANA Smart Data Integration DP Agent installed

Here are the main steps to set up this data flow:

Create a new on-premise agent in SAP Data Warehouse Cloud:

Administration ->Data Integation -> On-Premise Agents

Note down the above agent connection information for SAP HANA Smart Data Integration DP Agent configuration in the following steps.

Step for Azure Data Explorer:

Get Azure Data Explorer cluster connection information from Azure service page:

Steps for SAP HANA Smart Data Integration DP Agent. :

Download Microsoft JDBC driver. Use this link for more information:https://help.sap.com/viewer/7952ef28a6914997abc01745fef1b607/2.0_SPS05/en-US/3fa7f534e564409b9b08d72a42da70de.html 

Copy Microsoft JDBC driver into file folder <DPA_install_dir>\lib on SAP HANA Smart Data Integration DP Agent server:

Use DP Agent Configuration Tools to setup the connection to SAP Data Warehouse Cloud:

select item 6 (SAP HANA Connection) and then select item 2 (connection to SAP Data Warehouse Cloud via JDBC)

The connection information is from the step that creates the on-premise agent in SAP Data Warehouse Cloud.

Check the on-premise agent status in SAP Data Warehouse Cloud and register MssqlLogReaderAdapter in on-premise agent setting:

Administration ->Data Integration -> On-Premise Agents

Check MssqlLogReaderAdapter and Save it

Create local connections in SAP Data Warehouse Cloud:

Space Management-> <Your working Space> -> Connections -> Local Connections

Create a new local connection for Azure Data Explorer (using Microsoft SQ Server connection type)

Import remote table in SAP Data Warehouse Cloud:

Select the tables in Azure Data Explorer and import it.

Now the remote tables for Azure Data Explorer are available in SAP Data Warehouse Cloud. These remote tables can be used in view, analytical dataset, or the other places.

The queries against these remote tables will be pushed down to Azure Data Explorer through the SAP Smart Data Integration DP Agent and it also brings the query result back to SAP Data Warehouse Cloud for further use.

Thanks for reading.  If you have any questions, please reach out to ci_sce@sap.com.