Regardless of where your data is, there is a method to move your data into SAP HANA. Our Customer Innovation team has compiled this blog series to provide step-by-step instructions for moving your data.
In this installment, we will show you how to move your data from Microsoft Azure Data Explorer to SAP HANA Cloud. We will go through a case where we want to access data in Azure Data Explorer using SAP Data Intelligence. When researching solutions within SAP channels, we found that there was no standard process for addressing this, so we wrote this article in hopes that people in a similar situation will find it useful.
As Azure Data Explorer provides a RESTful way with Oauth2 for data consuming, we decided to use the SAP Data Intelligence built-in operator OpenAPI Client. Here are the main steps:
- First of all, we need a database created under a cluster of Azure Data Explorer. This database supports kusto query language and can be accessed via RESTful services with Oauth2.
- Creat a test graph in SAP Data Intelligence looking like this:
The JS operator, FormData, sends necessary message header information needed by the built-in operator OpenAPI Client. The JS code inside the FormData operator should include some information like payload in the message body:
Payload is what needed REST APIs from Azure data explorer. Attribute csl is the kusto query you should run. You can refer to the Azure documentation for more information.
Configure the OpenAPI Client operator:
The most important part is Oauth2 Scope. In our case, we set it to https://help.kusto.windows.net/.default. You will find instructions in Azure documents for the detailed values of attributes like host, base path, Token URL, Client ID and Client Secret. As for Oauth2 Flow, it should be set to “application.” If your configuration is set correctly, after running the graph, you should be able to see following output from OpenAPI Client :
- The last JS operator “transform data” uses Javascript to transform data from byte array to csv which will be read and saved into other data bases like SAP HANA Cloud later using HanaClient operator from SAP Data Intelligence. If everything is OK, we should see a csv data result in the wiretap operator.
Before we wrap up, it is important to note that the OpenAPI Client operator is compatible with Oauth2. Make sure to double-check Azure documents regarding REST APIs in Azure Data Explorer, to ensure that you refer to the right version.
Thanks for reading. If you have any questions, please reach out to ci_sce@sap.com.
- SAP Managed Tags:
