Step-by-step: Setup SDI for your HCP account (part 1)
For an introduction on smart data integration (SDI) for HCP check this post > Smart Data Integration available for HCP
This current blog will provide step-by-step instructions on how to set up SDI for your HCP account. The prerequisite will be that you have an HCP account with a HANA database-as-a-service and also have a license that enables you to use SDI and download the required components from SAP service market place. A future blog post will explain how you can use SDI on the trial landscape (not available yet).
We’ll cover the end to end process until you see some sample data from an onPremise source (we will use a file for simplicity) in your HANA database on HCP. Once you reach this step, you’ll be able to extend it yourself to more advanced scenarios.In summary, we’ll go to these steps:
- Download the required software components
- Use HANA Studio to enable the Data Provisioning Server
- Import the SDI delivery unit
- Create HANA users with the required permissions
- Install and configure the SDI agent to connect to your cloud instance
- Setup a test to read a file and load to a HANA table
1. Download the required software components
First we will download the SDI agent and SDI delivery unit. Customers with a valid license for SDI will be able to see the downloads from SAP service market place. Please make sure you go to the “Support packages and patches” or “Maintenance Product” area to see all available versions (and not just the initial release). The easiest way to find the downloads is use the Search capability on https://launchpad.support.sap.com/#/softwarecenter and search for SDI.
The choice of which support package (SP) of SDI you need depends on your HANA database. SDI SP01 was released for HANA SPS10, SDI SP02 for HANA SPS11 and SDI SP03 for HANA SPS12. However each SDI SP has a backward and forward compatibility for one HANA version.
The table below lists the supported combinations of SDI agent and HANA database version :
|
HANA SPS10 (available on HCP, also used for HCP trial) |
HANA SPS11 (available on HCP) |
HANA SPS12 (released in May 2016, not available on HCP yet) |
|
|
SDI SP01 |
Yes |
Yes (1 forward) |
– |
|
SDI SP02 |
Yes (1 backward) |
Yes |
Yes (1 forward) |
|
SDI SP03 |
– |
Yes (1 backward) |
Yes |
We currently recommend to use SDI SP02 because it can be used with all available HANA versions on HCP. Also make sure you take the latest patch for SP02.You need at least patch 3 for the SP02 SDI agent and patch 2 for the SP02 SDI delivery unit, these patches have critical enhancements for using SDI with HCP.
You will find the SDI delivery unit via this navigation path: SAP HANA SDI >> SAP HANA SDI 1.0 >> COMPRISED SOFTWARE COMPONENT VERSIONS >> HANA DP 1.0 >> # OS INDEPENDENT >> SP02 Patch2 for HANA DP 1.0 = HANAIMDP02P_2-70000027.ZIP
You will find the SDI agent via this navigation patch: SAP HANA SDI >> SAP HANA SDI 1.0 >> COMPRISED SOFTWARE COMPONENT VERSIONS >>
HANA DP AGENT 1.0 >> select Windows or Linux in dropdownbox >> SP02 Patch 3 for HANA DP Agent 1.0 =
IMDB_DPAGENT100_02_3-70000175.SAR (Windows) or IMDB_DPAGENT100_02_3-70000174.SAR (Linux)
Note in order to unpack the .SAR file, you will also need the SAPCAR utility, which can be download from the software center as well. SAPCAR is a command line utility, similar to the linux “tar” command, also with similar syntax. The command to unpack the agent would be:
sapcar.exe -xvf IMDB_DPAGENT100_02_3-70000175.SAR
2. Use HANA Studio to enable the Data Provisioning Server
For most of the steps in this blog, we will use the web based UIs, however there’s a one-time setup step to enable the data provisioning server that requires HANA Studio. Where possible we will use the HANA WebIDE, but if you prefer HANA Studio you can also do the remaining steps in Studio.
As a pre-requisite you will need to have HANA Studio installed, with the plugin for the HANA Cloud Platform so that you can connect to the HANA database on HCP. How to obtain HANA Studio and the plugin is installed on this page in the help portal:SAP HANA Cloud Platform.
In HANA Studio, create a connection to your HANA database on HCP.
- Right click on the system name in the list of systems and select “Configuration and Monitoring” -> “Open Administration”
- Go to the “Configuration” tab
- Navigate to “daemon.ini” -> “dpserver”
- Double click on the “instances” property to change the value from 0 to 1
No save or restart needed, the dpserver will get started right away and will be available within seconds. On the “Landscape” tab under “Services” you should see the dpserver service running now.
3. Import the SDI delivery unit
The SDI delivery unit need to be imported in your HANA database in order for the agent to communicate over HTTPS to your data provisioning server. The same delivery unit will also add the SDI monitoring user interface.Once you have downloaded the .ZIP file from service market place, unzip to get the .tgz file which contains the delivery unit. It will be named like HANAIMDP.tgz. You can import the delivery unit through the web based ILM (Information Lifecycle Management) application, but since we have HANA Studio still open, let’s use HANA Studio.
- In HANA Studio go to the menu File / Import…
- Select in the folder “SAP HANA Content” > “Delivery Unit”
- In “Systems for import” select your HCP HANA database
- Select file from “Client” and browse to the .tgz file with the delivery unit.
- Click Finish
For the next steps go the part 2 of this blog: Step-by-step: Setup SDI for your HCP account (part 2).
Hi Ben,
I used only Web based UI for all the activities and didn't have to manually activate the DP server as mentioned in step 2. I wonder how it worked for me earlier đ
Hi Ben,
I don't see daemon.ini when I go to configuration, I am logged in as a system user, any idea?
Kapadia, then you must be logged in to a multi-tenant HANA database (MDC). You will not see the daemon.ini for tenant databases. E.g. HANA Trial are all MDC HANA instances.
For HANA trial, I have a separate blog where enabling the DPserver is done when you request your HANA instance.
https://blogs.sap.com/2016/07/14/step-by-step-setup-sdi-for-your-hcp-trial-account/
If you are not on HANA trial, you could try this command to enable the DP server in your HANA tenant:
ALTER DATABASE <database_name> ADD âdpserverâ AT LOCATION â<hostname>[:<port_number>]â
See doc link.
Thanks,
Ben.
Hi Ben  i have some problem in this step
21 Mar 2017, 09:31:16 1 Change Failed to enable HTTPS access from Internet P1942505191
21 Mar 2017, 09:31:16 1 Change Error when registering hostname 'franciscopocp1942505191trial' in load balancer for HANA database in account 'p1942505191trial' and
id 'franciscopoc': Failed to register pool prefix [franciscopocp1942505191trial] for server vadbi0m.nwtrial.od.sap.biz:8041
Error ID: 099ffc61-e36a-4f31-aa34-ab5e8199fb29 P1942505191
did you know how i solve this problem
Hello Ben,
I hope you are fine.
If you do not mind, can you get me some initial questions (still about the installation process)?
1) Instead of doing the donwload not launchpad.support.sap.com I can do direct without tools.hana.ondemand.com that will already give me a last version, right?
2) Can I use Eclipse or should I necessarily use HANA Studio? WEB IDE do bank can be used direct?
3) What version of SAPCAR should I download? Any of them?
From now we appreciate your willingness to share your knowledge with us and our collaborators with doubts.
Thallita,
For 1) -> YES, you can get the SDI DP agent and DU from tools.hana.ondemand.com. It might not be the very latest version you get there, but itâs a working version ;-). You can always apply a patch later.
For 2) HANA Studio is just Eclipse with the right plugins. So yes, you can use Eclipse. The only step you cannot do with Web IDE is the import of the DU and enabling the DP server. All others steps can be done with Web IDE (and Web IDE is the recommended tool for these steps).
For 3) Any version of SAPCAR should work. If you go for 1) and get the download from tools.hana.ondemand.com, you will not need SAPCAR, we have a regular zip flle on the tools site.
Thanks,
Ben.
What license do I need to use SDI between a HANA database-as-a-service of a SAP CP account and an onpremise database (eg. Microsoft SQL Server)?
From SAP side you need one of the âCloud Platform Integrationâ editions, this includes the license to use SDI.
To connect to your SQL Server database, you obviously need the appropriate Microsoft full-use licenses, nothing in addition required from SAP.
Thanks,
Ben.
Hi Ben,
Is it possible to call a odata/rest service using SDI?
E.g: Based on a change to table in source system, replicate the same into destination system and also trigger a service maintained in SAP Cloud Platform?
Best Regards,
Ashok.
Hello Experts,
I am using Hana Express edition and not able to register dp agent.
while i am connected with user SYSTEM i am not even able to change
âdaemon.iniâ -> âdpserverâ -> Instance value from 0 to 1
Any help ? đ
Thanks in advance.