Skip to Content
Author's profile photo Werner Daehn

Hana Smart Data Integration – Installing the DP Agent

The Data Provisioning Agent hosts all SDI Adapters and acts as the communication interface between Hana and the Adapter. As such the DP Agent version has to match the Hana version. Which version to use is best found out by looking at the PAM (link) for Hana SDI, the Essential Information document.

Agentinstall0.png

The DP Agent can be installed anywhere and one Hana instance can have many agents configured. Hence there is a great freedom. Some adapters might have certain requirements however, e.g. a File Adapter can read all files it has access to. In order to read a file from a local disk drive, the File Adapter and therefore one Agent has to be installed on this local computer.

see architecture

The SDI Agent can be downloaded as SAR file from SAP Service Marketplace like any other SAP application, provided it was licensed.

Agentinstall1.pngAgentinstall2.png

As the Adapters are written in Java, it is a good idea to check if Java is installed and what version.

Agentinstall3.png

The actual installation is straight forward. The hdbsetup.exe guides through the installation steps.

Agentinstall4.png

Since this is a network service, in case of Windows the domain\username (or hostname\username for local users) has to be provided. And then the service does listen on the two TCP/IP ports, by default 5050 and 5051.

Agentinstall5.png

When the installation is finished, the Windows Services should have a “SAP Hana Data Provisioning Agent” running.

Agentinstall6.png

Now this new agent has to be made known in Hana by executing the create-agent SQL command.The same can be accomplished by running the dpagentconfigtool.

Agentinstall7.png

In order to execute SQL commands the tool has to connect to Hana using the JDBC driver (or https in case Hana is in a different network with a firewall inbetween, e.g. a cloud instance) and the user has to have the required permissions.

Agentinstall8.png

Once connected the tool executes the CREATE AGENT <agent name> PROTOCOL ‘TCP’ host <hostname or IP> PORT 5050; command to register an agent. Hence an arbitrary agent name has to be entered and the local hostname.

Note: When using the TCPIP protocol, it is the Agent listening and Hana initiating the communication. Therefore the hostname has to be know to the Hanas system. In larger organisations that means the full qualified hostname has to be used often. Or the static IP address of the Agent computer, if there is one. This gets especially tricky in case the Agent runs on a computer with DHCP.

Agentinstall9.png

At the end the dpagentconfigtool should show that it is connected to Hana successfully, the agent name is registered and the agent is running and listening as shown below.

Agentinstall10.png

Assigned Tags

      29 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo Kshitiz Bhattarai
      Kshitiz Bhattarai

      Hi Werner,

      Can we have one more SCN article describing how to setup connect to hana for on cloud scenario with config tool?

      Thanks,

      kb

      Author's profile photo Former Member
      Former Member

      Hi KB, I already have a blog series covering SDI for HCP. It also includes step-by-step instructions on setting up agent and data provisioning server.

      Smart Data Integration available for HCP

      Thanks,

      Ben.

      Author's profile photo Former Member
      Former Member

      /wp-content/uploads/2016/08/1_1026125.pngHi,

      I cant register the Agent. I can connect to HANA.

      It doesn't matter what I type in the field Agent Name?

      in the Hostname field i tried ip adress and Full Hostname.

      Doesn't help.

      Regards

      Tom

      Author's profile photo Yuriy Volosenko
      Yuriy Volosenko

      Hi Tom,

      you have to start Agent as Admin. Enter ip insted of Hostname. Also take look in Firewall settings. You have to create inbound rule like folow.Restart you Agent. Also corp domain can make troubles.

      /wp-content/uploads/2016/09/bild_1029380.jpg

      Author's profile photo Former Member
      Former Member

      Hi Tom,

      Did you ever able to solve this problem.? I have the same issue.

      Regards,

      Sai

      Author's profile photo Former Member
      Former Member

      Hi Sai,

      that was a Firewall issue.

      Check really everything.

      🙂

      Best

      Tom

      Author's profile photo ram nath
      ram nath

      Hi Werner

      We have installed the HANA SDI Excel agent as well but in the definition we are not getting scaling factor like decimal(P,S)
      Ex : Decimal(34,2) for the calculation  of currency,it is showing the value in the data preview but  $110.894888888889 like this it is showing ,I applied filter to restrict the datatype as 32,2 (or) 34,2  throws an error of inconsistent model.

      Author's profile photo Werner Daehn
      Werner Daehn
      Blog Post Author

      That's a bug in the Excel adapter then.

      Author's profile photo Former Member
      Former Member

      Hi Werner

      This is fantastic blog. It is very useful. We have recently installed DP Agent with the help of this blog. And it is working fine  We are trying to bring data from SQL Sever 2012 to HANA DB using SDI and Data Provisioning Technologies. We have created HANA virtual tables on SQL Server database's tables and it has same structures and data types as tables in SQL Sever database.

      But we have encountered an issue and it is very critical for us in our project.

      Issue: -  when we do data preview on HANA virtual table which has same table structure and data type as SQL Server, we seeing that data/numbers are converting into Bytes in HANA. This is only when  columns of numeric data types (SMALLINT) may get inserted into the database with incorrect values.

      For example, a SMALLINT value of 1 may be seen inserted into the database(HANA) as value 256.

      It would really great if you have any suggestions on this.

      We have installed our HANA SPS 11 on IBM Power 8 System which is on Linux OS. I am not sure if it is JDBC driver issue or OS level issue.
      Thanks,
      Hardik

       

      Author's profile photo ram nath
      ram nath

      Thanks  Werner Daehn for the reply .Can we expect it will be fixed with any patches or need to wait for the next release of SDI.

      Author's profile photo Former Member
      Former Member

      Hi Werner

      This is fantastic blog. It is very useful. We have recently installed DP Agent with the help of this blog. And it is working fine  We are trying to bring data from SQL Sever 2012 to HANA DB using SDI and Data Provisioning Technologies. We have created HANA virtual tables on SQL Server database’s tables and it has same structures and data types as tables in SQL Sever database.

      But we have encountered an issue and it is very critical for us in our project.

      Issue: –  when we do data preview on HANA virtual table which has same table structure and data type as SQL Server, we seeing that data/numbers are converting into Bytes in HANA. This is only when  columns of numeric data types (SMALLINT) may get inserted into the database with incorrect values.

      For example, a SMALLINT value of 1 may be seen inserted into the database(HANA) as value 256.

      It would really great if you have any suggestions on this.

      We have installed our HANA SPS 11 on IBM Power 8 System which is on Linux OS. I am not sure if it is JDBC driver issue or OS level issue.
      Thanks,
      Hardik

       

      Author's profile photo Former Member
      Former Member

      Hi Guys,

       

      I managed to start agent and also connected to HANA,

      EMBEDDED
      ENABLED
      DISABLED
      ENABLED
      No issues with firewall but i dont see any adapters. could you please help me pointing me where i got screwed,, now i cannot register  agent.
      i am trying to implement real cool stuff here..
      i am using HCP
      Br,
      Gabriel
      Author's profile photo Bert Braasch
      Bert Braasch

      Dear Ashlin,

       

      i'm not familiar with the HCP connection but you first have to register the agent. As soon as the dp agent is registered on the HANA machine you have all the adapter available in this list.

       

       

      Kind regards,

      Bert Braasch

      Author's profile photo sanae Louzza
      sanae Louzza

      Hello Former MemberFormer Member

       

      I'm facing the same problem, could you please give me the steps you followed to register your agent

       

      Thank you .

      Author's profile photo Former Member
      Former Member

      Hi,

       

      I am facing the same issue, please tell me the steps to register agent?

      Author's profile photo Bert Braasch
      Bert Braasch

      Hello all together,

      man this place got moved around a little bit so sorry for the delay.

      You just press the button "register agent" in the field agent registration. Then you give an agent name and an agent hostname.

      The agent hostname is the machine on which you have started the confguration tool. The value may already be pre filled and the agent name is just the name how the agent is called in the corresponding HANA system.

       

      Hope that helps.

       

      Kind regards,

       

      Bert Braasch

      Author's profile photo Former Member
      Former Member

       

      Hello,

      Can someone please tell me what Domain/Username I need to mention ?

       

      Author's profile photo Bert Braasch
      Bert Braasch

      Dear Suraj,

      please have a look at the offical guide:

      https://help.sap.com/viewer/7952ef28a6914997abc01745fef1b607/1.0_SPS12/en-US/dd8aaa71a6d4490485b8eb5123f46149.html

       

      5 Specify the user credentials to use for the agent service.

      • On Windows, the username (<domain>\<username>) and password.

        The user that runs the agent service must have read/write access to the installation directory so that configuration files can be updated.

      If you are installing the dp agent for a local user (no domain user) you have to use the hostname of the pc for example:

      suraj-pc\suraj

      You can find your hostname under the windows systems settings. Look for computer name it's on the same area where you can change your workgroup.

       

       

      Kind regards,

      Bert Braasch

       

      Author's profile photo Former Member
      Former Member

      Dear Bert ,

      Thanks a lot for your comment .

      I have successfully installed DP agent and I can see Camel folder as well in my dataprovagent.JAR files have been copied in the lib folder .I have edited the Manifest file as well but when I am trying to open Configuration in C:\usr\sap\dataprovagent\configTool\dpagentconfigtool.exe it is showing me the below error which is traced in C:\usr\sap\dataprovagent\configTool\workspace\.metadata\.log .Below is the error .

      java.lang.Exception: Config tool start failed
      at com.sap.hana.dp.agentconfig.app.Application.start(Application.java:171)
      at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
      at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
      at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
      at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380)
      at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:498)
      at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:669)
      at org.eclipse.equinox.launcher.Main.basicRun(Main.java:608)
      at org.eclipse.equinox.launcher.Main.run(Main.java:1515)

      Author's profile photo Vladimir Kogan
      Vladimir Kogan

      Hi.

      Do you have a solution for this problem?

      Regards

      Vladimir

       

      Author's profile photo Christopher Buck
      Christopher Buck

      I also have this problem so wondering whether you have the solution.  Through my research I think I am missing some 32 bit libraries from my SAP HXE install on GCP..

      Author's profile photo KANAGARASU SAMINATHAN
      KANAGARASU SAMINATHAN

      Hello,

      Thanks for the excellent blog about SDI and DP installation

      I have an question. In our scenario, we have to replicate from HANA to HANA

      We have to Replicate from ECC HANA DB (Host-XYZ) to BW HANA DB (Host-ABC) – On top of this we use BO for real time reporting.

      Now, where do we deploy DP agent? on Host ABC? or On HOST XYZ? or do we need separate host for SP agent that is near to ECC HANA DB(Host-XYZ)?

      Please clarify

      Thanks in advance

      Best Regards,

      Kanagu.S

       

      Author's profile photo ANMOL SAHU
      ANMOL SAHU

       

      Hi Werner,

       

      Thanks for an excellent blog!

       

      Using step by step process, I was able to install DP Agent and connect with IBP (Integrated Business Planning) for SDI Oder based Planning using Supply and Response.

       

      Thanks again for the information & blog!!

       

      Cheers,

       

      Anmol Sahu

      Author's profile photo Adi Yakkala
      Adi Yakkala

      Hi,

       

      I am getting following error during installation..

       

      Cannot install
      File not found: C:\usr\sap\dataprovagent\ssl\cacerts
      File not found: C:\usr\sap\dataprovagent\configTool\dpagentconfigtool.ini
      File not found: C:\usr\sap\dataprovagent\dpagent.ini
      File not found: C:\usr\sap\dataprovagent\dpagentconfig.ini
      Cannot install Microsoft C/C++ Runtime
      Starting external program C:\softwares\SDI\latest\HANA_DP_AGENT_20_WIN_X86_64\packages\msdev2015_vcredist_x64.exe
      Command line is: C:\softwares\SDI\latest\HANA_DP_AGENT_20_WIN_X86_64\packages\msdev2015_vcredist_x64.exe /q
      Program terminated with exit code 1638

       

      Any ideas where am i going wrong?

       

      Thanks,

      Adi

      Author's profile photo Nihad Catak
      Nihad Catak

      Hi Adi,

      I just had the same issue.

      Take a look here:

      https://answers.sap.com/answers/451052/view.html

       

      regards

      Nihad

      Author's profile photo Prashanth R
      Prashanth R

      Hello,

      Error : Agent is not exits as installed service.

      I am trying to install the DP Agent on windows server 2016 following this blog, i am able to do all and successfully install fully.

      But after installing “Service” not starting.

      the Windows Services not listing “SAP Hana Data Provisioning Agent” service, i tried starting it manually by clicking "C:\usr\sap\dataprovagent\bin\DPAgentService.exe" but still the service is not up.

      I have enabled full privileges to the user for the directory.

      But it works in local windows machine.

      Thanks in advance,

      Prashanth

      Author's profile photo Hegui Liu
      Hegui Liu

      Hi,

      I installed DP Agent on Linux (in Vwmare), but the Agent can't start. It seems for linux the default is Sybase adapter, but I installed the MSSQL.

      Whenever I tried to start Agent, I always get issue:

      Agent service location: /home/vagrant/Documents/sap/dataprovagent/bin/dpagent_service.sh
      dpagent_service.sh location: /home/vagrant/Documents/sap/dataprovagent/bin/dpagent_service.sh
      Starting agent service. Command: /home/vagrant/Documents/sap/dataprovagent/bin/dpagent_service.sh start
      Start service return code: 2
      Exception
      ************************************************************
      Exception occured: Failed to start dpagent_service. Return code: 2
      java.lang.RuntimeException: Failed to start dpagent_service. Return code: 2
      at com.sap.hana.dp.agentutils.operations.AgentConfigTool.startAgent(AgentConfigTool.java:820)
      at com.sap.hana.dp.agentutils.operations.AgentConfigTool.callOperation(AgentConfigTool.java:329)
      at com.sap.hana.dp.agentutils.operations.AgentConfigTool.executeOption(AgentConfigTool.java:642)
      at com.sap.hana.dp.agentutils.main.OperationHandler.processCommand(OperationHandler.java:138)
      at com.sap.hana.dp.agentutils.main.AgentCmdLine.main(AgentCmdLine.java:66)
      What can I do?

      Regards,

      Hegui Liu

      Author's profile photo Denish Velachhawala
      Denish Velachhawala

      Hi,

      I am using Hana Connection for data loading through SDI DP Agent. My installation is successful and my Profile in IBP UI is also setup successfully. When I try to upload data files through UI I am getting this following error :

      1. "The remote source you are using for data integration is technically working, but IBP cannot access or find IBP_version table"

      2. "There was an error when OpenAPI tried to access the IBP_VERSION table."

      3. "When OpenAPI accessed the IBP_VERSION table in your staging area, it couldn't find any valid entries."

      But I have all the data files available for upload of the data loads and the same thing is working in some other system. Please help me to understand and resolve this issue.

       

      Thanks & Regards,

      Narasimhan

      Author's profile photo Divya Thaore
      Divya Thaore

      Can anyone please help me with this one : https://answers.sap.com/questions/13612865/unable-to-start-the-sap-dp-agent-service-daemon.html