Hana Smart Data Integration – Installing the DP Agent
The Data Provisioning Agent hosts all SDI Adapters and acts as the communication interface between Hana and the Adapter. As such the DP Agent version has to match the Hana version. Which version to use is best found out by looking at the PAM (link) for Hana SDI, the Essential Information document.
The DP Agent can be installed anywhere and one Hana instance can have many agents configured. Hence there is a great freedom. Some adapters might have certain requirements however, e.g. a File Adapter can read all files it has access to. In order to read a file from a local disk drive, the File Adapter and therefore one Agent has to be installed on this local computer.
The SDI Agent can be downloaded as SAR file from SAP Service Marketplace like any other SAP application, provided it was licensed.
As the Adapters are written in Java, it is a good idea to check if Java is installed and what version.
The actual installation is straight forward. The hdbsetup.exe guides through the installation steps.
Since this is a network service, in case of Windows the domain\username (or hostname\username for local users) has to be provided. And then the service does listen on the two TCP/IP ports, by default 5050 and 5051.
When the installation is finished, the Windows Services should have a “SAP Hana Data Provisioning Agent” running.
Now this new agent has to be made known in Hana by executing the create-agent SQL command.The same can be accomplished by running the dpagentconfigtool.
In order to execute SQL commands the tool has to connect to Hana using the JDBC driver (or https in case Hana is in a different network with a firewall inbetween, e.g. a cloud instance) and the user has to have the required permissions.
Once connected the tool executes the CREATE AGENT <agent name> PROTOCOL ‘TCP’ host <hostname or IP> PORT 5050; command to register an agent. Hence an arbitrary agent name has to be entered and the local hostname.
Note: When using the TCPIP protocol, it is the Agent listening and Hana initiating the communication. Therefore the hostname has to be know to the Hanas system. In larger organisations that means the full qualified hostname has to be used often. Or the static IP address of the Agent computer, if there is one. This gets especially tricky in case the Agent runs on a computer with DHCP.
At the end the dpagentconfigtool should show that it is connected to Hana successfully, the agent name is registered and the agent is running and listening as shown below.
Hi Werner,
Can we have one more SCN article describing how to setup connect to hana for on cloud scenario with config tool?
Thanks,
kb
Hi KB, I already have a blog series covering SDI for HCP. It also includes step-by-step instructions on setting up agent and data provisioning server.
Smart Data Integration available for HCP
Thanks,
Ben.
I cant register the Agent. I can connect to HANA.
It doesn't matter what I type in the field Agent Name?
in the Hostname field i tried ip adress and Full Hostname.
Doesn't help.
Regards
Tom
Hi Tom,
you have to start Agent as Admin. Enter ip insted of Hostname. Also take look in Firewall settings. You have to create inbound rule like folow.Restart you Agent. Also corp domain can make troubles.
Hi Tom,
Did you ever able to solve this problem.? I have the same issue.
Regards,
Sai
Hi Sai,
that was a Firewall issue.
Check really everything.
🙂
Best
Tom
Hi Werner
We have installed the HANA SDI Excel agent as well but in the definition we are not getting scaling factor like decimal(P,S)
Ex : Decimal(34,2) for the calculation of currency,it is showing the value in the data preview but $110.894888888889 like this it is showing ,I applied filter to restrict the datatype as 32,2 (or) 34,2 throws an error of inconsistent model.
That's a bug in the Excel adapter then.
Hi Werner
This is fantastic blog. It is very useful. We have recently installed DP Agent with the help of this blog. And it is working fine We are trying to bring data from SQL Sever 2012 to HANA DB using SDI and Data Provisioning Technologies. We have created HANA virtual tables on SQL Server database's tables and it has same structures and data types as tables in SQL Sever database.
But we have encountered an issue and it is very critical for us in our project.
Issue: - when we do data preview on HANA virtual table which has same table structure and data type as SQL Server, we seeing that data/numbers are converting into Bytes in HANA. This is only when columns of numeric data types (SMALLINT) may get inserted into the database with incorrect values.
For example, a SMALLINT value of 1 may be seen inserted into the database(HANA) as value 256.
It would really great if you have any suggestions on this.
Thanks Werner Daehn for the reply .Can we expect it will be fixed with any patches or need to wait for the next release of SDI.
Hi Werner
This is fantastic blog. It is very useful. We have recently installed DP Agent with the help of this blog. And it is working fine We are trying to bring data from SQL Sever 2012 to HANA DB using SDI and Data Provisioning Technologies. We have created HANA virtual tables on SQL Server database’s tables and it has same structures and data types as tables in SQL Sever database.
But we have encountered an issue and it is very critical for us in our project.
Issue: – when we do data preview on HANA virtual table which has same table structure and data type as SQL Server, we seeing that data/numbers are converting into Bytes in HANA. This is only when columns of numeric data types (SMALLINT) may get inserted into the database with incorrect values.
For example, a SMALLINT value of 1 may be seen inserted into the database(HANA) as value 256.
It would really great if you have any suggestions on this.
Hi Guys,
I managed to start agent and also connected to HANA,
Dear Ashlin,
i'm not familiar with the HCP connection but you first have to register the agent. As soon as the dp agent is registered on the HANA machine you have all the adapter available in this list.
Kind regards,
Bert Braasch
Hello Former MemberFormer Member
I'm facing the same problem, could you please give me the steps you followed to register your agent
Thank you .
Hi,
I am facing the same issue, please tell me the steps to register agent?
Hello all together,
man this place got moved around a little bit so sorry for the delay.
You just press the button "register agent" in the field agent registration. Then you give an agent name and an agent hostname.
The agent hostname is the machine on which you have started the confguration tool. The value may already be pre filled and the agent name is just the name how the agent is called in the corresponding HANA system.
Hope that helps.
Kind regards,
Bert Braasch
Hello,
Can someone please tell me what Domain/Username I need to mention ?
Dear Suraj,
please have a look at the offical guide:
https://help.sap.com/viewer/7952ef28a6914997abc01745fef1b607/1.0_SPS12/en-US/dd8aaa71a6d4490485b8eb5123f46149.html
5 Specify the user credentials to use for the agent service.
The user that runs the agent service must have read/write access to the installation directory so that configuration files can be updated.
If you are installing the dp agent for a local user (no domain user) you have to use the hostname of the pc for example:
suraj-pc\suraj
You can find your hostname under the windows systems settings. Look for computer name it's on the same area where you can change your workgroup.
Kind regards,
Bert Braasch
Dear Bert ,
Thanks a lot for your comment .
I have successfully installed DP agent and I can see Camel folder as well in my dataprovagent.JAR files have been copied in the lib folder .I have edited the Manifest file as well but when I am trying to open Configuration in C:\usr\sap\dataprovagent\configTool\dpagentconfigtool.exe it is showing me the below error which is traced in C:\usr\sap\dataprovagent\configTool\workspace\.metadata\.log .Below is the error .
java.lang.Exception: Config tool start failed
at com.sap.hana.dp.agentconfig.app.Application.start(Application.java:171)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:669)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:608)
at org.eclipse.equinox.launcher.Main.run(Main.java:1515)
Hi.
Do you have a solution for this problem?
Regards
Vladimir
I also have this problem so wondering whether you have the solution. Through my research I think I am missing some 32 bit libraries from my SAP HXE install on GCP..
Hello,
Thanks for the excellent blog about SDI and DP installation
I have an question. In our scenario, we have to replicate from HANA to HANA
We have to Replicate from ECC HANA DB (Host-XYZ) to BW HANA DB (Host-ABC) – On top of this we use BO for real time reporting.
Now, where do we deploy DP agent? on Host ABC? or On HOST XYZ? or do we need separate host for SP agent that is near to ECC HANA DB(Host-XYZ)?
Please clarify
Thanks in advance
Best Regards,
Kanagu.S
Hi Werner,
Thanks for an excellent blog!
Using step by step process, I was able to install DP Agent and connect with IBP (Integrated Business Planning) for SDI Oder based Planning using Supply and Response.
Thanks again for the information & blog!!
Cheers,
Anmol Sahu
Hi,
I am getting following error during installation..
Cannot install
File not found: C:\usr\sap\dataprovagent\ssl\cacerts
File not found: C:\usr\sap\dataprovagent\configTool\dpagentconfigtool.ini
File not found: C:\usr\sap\dataprovagent\dpagent.ini
File not found: C:\usr\sap\dataprovagent\dpagentconfig.ini
Cannot install Microsoft C/C++ Runtime
Starting external program C:\softwares\SDI\latest\HANA_DP_AGENT_20_WIN_X86_64\packages\msdev2015_vcredist_x64.exe
Command line is: C:\softwares\SDI\latest\HANA_DP_AGENT_20_WIN_X86_64\packages\msdev2015_vcredist_x64.exe /q
Program terminated with exit code 1638
Any ideas where am i going wrong?
Thanks,
Adi
Hi Adi,
I just had the same issue.
Take a look here:
https://answers.sap.com/answers/451052/view.html
regards
Nihad
Hello,
Error : Agent is not exits as installed service.
I am trying to install the DP Agent on windows server 2016 following this blog, i am able to do all and successfully install fully.
But after installing “Service” not starting.
the Windows Services not listing “SAP Hana Data Provisioning Agent” service, i tried starting it manually by clicking "C:\usr\sap\dataprovagent\bin\DPAgentService.exe" but still the service is not up.
I have enabled full privileges to the user for the directory.
But it works in local windows machine.
Thanks in advance,
Prashanth
Hi,
I installed DP Agent on Linux (in Vwmare), but the Agent can't start. It seems for linux the default is Sybase adapter, but I installed the MSSQL.
Whenever I tried to start Agent, I always get issue:
Agent service location: /home/vagrant/Documents/sap/dataprovagent/bin/dpagent_service.sh
dpagent_service.sh location: /home/vagrant/Documents/sap/dataprovagent/bin/dpagent_service.sh
Starting agent service. Command: /home/vagrant/Documents/sap/dataprovagent/bin/dpagent_service.sh start
Start service return code: 2
Exception
************************************************************
Exception occured: Failed to start dpagent_service. Return code: 2
java.lang.RuntimeException: Failed to start dpagent_service. Return code: 2
at com.sap.hana.dp.agentutils.operations.AgentConfigTool.startAgent(AgentConfigTool.java:820)
at com.sap.hana.dp.agentutils.operations.AgentConfigTool.callOperation(AgentConfigTool.java:329)
at com.sap.hana.dp.agentutils.operations.AgentConfigTool.executeOption(AgentConfigTool.java:642)
at com.sap.hana.dp.agentutils.main.OperationHandler.processCommand(OperationHandler.java:138)
at com.sap.hana.dp.agentutils.main.AgentCmdLine.main(AgentCmdLine.java:66)
What can I do?
Regards,
Hegui Liu
Hi,
I am using Hana Connection for data loading through SDI DP Agent. My installation is successful and my Profile in IBP UI is also setup successfully. When I try to upload data files through UI I am getting this following error :
1. "The remote source you are using for data integration is technically working, but IBP cannot access or find IBP_version table"
2. "There was an error when OpenAPI tried to access the IBP_VERSION table."
3. "When OpenAPI accessed the IBP_VERSION table in your staging area, it couldn't find any valid entries."
But I have all the data files available for upload of the data loads and the same thing is working in some other system. Please help me to understand and resolve this issue.
Thanks & Regards,
Narasimhan
Can anyone please help me with this one : https://answers.sap.com/questions/13612865/unable-to-start-the-sap-dp-agent-service-daemon.html