Skip to Content

Welcome to part 2 of this blog with step-by-step instructions on how to setup SDI for HCP.

Before starting here, make sure you have done all steps in part 1 or read the introduction here: Smart Data Integration available for HCP

4. Create HANA users with the required permissions

For connecting your SDI agent to HCP you will need two HANA users:

  • One can be your personal user, which you also use to connect to the HANA web IDE, and which you will use to configure the agent and manage adapters. We’ll call this user SDI_USER.
  • The other one is a technical user used by the agent for the continuous connection to the HANA on HCP. We’ll name this user the SDI_DP_AGENT.

You can create new users with your SYSTEM user, by going to the HANA Cockpit and select “Manage Roles and Users”. When you create these new users, don’t forget that the password you set will need to be changed at first login, so login at least once with each of these users to trigger the password change window.

Both of these users will need some specific authorizations. We’ll cover here a quick summary, the details about all the authorizations (some optional) are documented here: Assign Roles and Privileges – Administration Guide for SAP HANA Smart Data Integration and SAP HANA Smart Data Quality -…

The SDI_USER will need these authorizations:

  • Role: sap.hana.xs.ide.roles::CatalogDeveloper
  • Role: sap.hana.xs.ide.roles::EditorDeveloper
  • Role: sap.hana.xs.ide.roles::SecurityAdmin
  • Application privilege: sap.hana.im.dp.admin::Administrator
  • System privilege: AGENT ADMIN
  • System privilege: ADAPTER ADMIN
  • System privilege: CREATE REMOTE SOURCE

The SDI_DP_AGENT will only need this authorization:

  • Application privilege: sap.hana.im.dp.proxy::AgentMessaging

CreateUsers.JPG

5. Install and configure the SDI agent to connect to your cloud instance

Final step in the setup is to install and configure the on-premise agent. Before starting, let’s look at the prerequisites:

  • You will need a Windows or Linux (virtual) server. Supported operating systems are Windows 2008, 2008 R2, 2012 and 2012 R2, for Linux SuSE 11 and ReHat 6.3 and 6.5. For a simple test you could also use your windows desktop – not officially supported, but working fine for me.
  • You will also need JAVA 7 installed on your machine, so make sure it’s installed and that the JAVA bin directory is added to the PATH variable so that SDI can find it.
  • You need to have a Windows user created which will be used to start and run the data provisioning agent service.
  • Your machine needs to be able to communicate to the internet. If you are within a corporate network, this will probably need to go through a proxy server, make sure you know the name and port for the proxy server you can use.

Next you run the installer that you find in the package downloaded in step 1 (hdbsetup.exe). Provide the installation path and the Windows user and password and accept all other default values. The installation will only take a couple of minutes.

DPagentinstall.JPG

Once the data provisioning agent is installed, you can run the configuration tool to connect the agent to your HANA instance in the cloud. To start the configuration tool, go to the installation directory, navigate to the ConfigTool folder and start dpagentconfigtool.exe (defaul location: C:\usr\sap\dataprovagent\configTool\dpagentconfigtool.exe).

Once the data provisioning agent is installed, you can run the configuration tool to connect the agent to your HANA instance in the cloud. To start the configuration tool, go to the installation directory, navigate to the ConfigTool folder and start dpagentconfigtool.exe (default location: C:\usr\sap\dataprovagent\configTool\dpagentconfigtool.exe).

In the Agent Configuration tool, click on “Connect to HANA” and complete the fields in the connection information screen:

  • Check “HANA on Cloud” and “Use HTTPS“. This will trigger an automatic import of SSL certificates once you click connect later on.
  • Provide the HANA hostname. You can get this from the HANA cockpit URL, remove the “https” from URL and remove everything after ondemand.com. What’s left is your HANA hostame.
  • Specify the SDI user, and password like the SDI_USER created in step 4.
  • If you connect from within a network that requires a proxy to access the internet, check the “Use HTTP proxy” and specify the proxy hostname and port. Check with your local network admin for these values, or re-use what is setup for you in your browser settings. If you connect from home, you usually don’t need a proxy.
  • Finally specify the technical user’s user name and password , like the SDI_DP_AGENT as created in step 4. There is an option to auto-create this user, but this will only work if your SDI_USER has the authorization to create new users.

Once done click Connect and if any error message is returned, read carefully to see what’s wrong. If you don’t see any errors, your agent is successfully connected to the HANA database on HCP.

DPagentConfig.JPG

Once you have successfully connected, you can also register the agent.  Click on “Register Agent” and provide a name that uniquely identifies this agent. Tip: it’s useful to include the machine name as part of the name, so that later when you have multiple agents, from within the HANA WebIDE, you will be able to identity where an agent is physically located.

DPagentConfig_register.JPG

Congratulations, you have setup SDI for HCP now. Let’s add one final step to test out a simple scenario for loading a file into HANA on HCP: Step-by-step: Setup SDI for your HCP account (part 3 – testing things out)

To report this post you need to login first.

41 Comments

You must be Logged on to comment or reply to a post.

  1. Gustavo Simil

    Hi Ben,

    congratulations for this great blog. This is something we’ve been waiting for a long time. It will certainly help us a lot.

    We want to connect our HCP HANA Instance (not trial) with our onpremise SAP IDES system. I successfully followed all the steps you mentioned in the blog. The agent is registered and I can see it on HANA agents view.

    However, when I try to register the adapter “Mssqleccadapter”, I get this error message:

    Capturar.PNG

    I have already included the SQL JDBC drivers in the lib directory.

    Do you know what could be the problem? Is HCP already prepared for this type of integration?

    Thanks again for your work with this blog!

    Gustavo

    (0) 
    1. Ben Hofmans Post author

      Hi Gustavo, yes, what you are trying to do should definitely work on HCP. In fact I have a demo system of my own where I replicate data in real-time from an on-premise SQL Server database into HANA on HCP. So there must be some config error in your agent/adapter install.

      Copying the SQL Server JDBC driver in the lib folder inside your dpagent install should indeed be all you need to do + a restart of the agent (did you restart ?)

      To troubleshoot this, you might want to check the framework.trc in the log directory, this log file should contain some more details.

      To get more detailed help, you can also create a support message. The component to use would be HAN-DP-SDI.

      Thanks,

      Ben.

      (0) 
    2. Gustavo Simil

      Thanks Ben. I had to restart the server, but after that I was able to register the adapter.

      Now I’ll try to configure the remote source and perform some tests with SDI!

      Thanks!

      (0) 
  2. Pfau Patrick

    Hey Ben,

    nice work, thanks much!

    One – maybe stupid – question: Playing around with the ABAP-Adapter I can see only a few of the tables of my IDES-system. How is it possible to add, for instance, customer z-tables to the list of available tables?

    Thanks & best regards,

    Patrick

    (0) 
    1. Ben Hofmans Post author

      Hi Patrick, indeed with the current version of the ABAP adapter you only see tables from the application hierarchy, so e.g. Z-tables would not be part of this. Also for systems where SAP_APPL component is not available, an application hierarchy of tables will not be available.

      We are making enhancements now to the ABAP adapter to be able to browse tables by name as well. This will enable you to use any table, including the Z-tables.

      A first fix went into the SDI agent SP03 patch 1 (1.3.1 – released July 8), but it seems the fix only works when browsing through HANA Studio, not HANA Web IDE, so there’s still some more work to do.

      Ben.

      (0) 
      1. Pfau Patrick

        Hi Ben,

        thanks much for your answer.

        Just updated the agent and did a quick queck –> looks good in Eclipse / HANA Studio.

        At least I can now see all tables, a handy search function will be highly appreciated in future updates.. ūüôā

        Thanks again and all the best,

        Patrick

        (0) 
          1. Pfau Patrick

            Hi Sridhar,

            should be fairly simple:

            1. update SDI agent to latest release

            2. connect to HCP HANA as described in this article

            3. Register ABAPAdapter via SDI agent

            4. In Eclipse / HANA studio: create a new remote source of type ABAPAdapter.

            Enter SAP Host / Client Number / System ID and enter the credentials of an technical user

            Now you should see the tables clustered by appl. hierarchy, by name and also the extractors.

            There is nothing more to configure here..

            All the best,

            Patrick

            (0) 
  3. Harish Yarra

    Hi Ben,

    Thanks for the valuable information on HCP SDI.

    Everything is working fine as you mentioned in the blog, but i can see one typo mistake in roles section.

    • Role: sap.hana.xs/ide.roles:: SecurityAdmin

    Correct one :

    • sap.hana.xs.ide.roles::SecurityAdmin

    Nice work, Keep it up..!

    Regards,

    Harish

    (0) 
  4. abhijit N

    Ben,

    First of all thanks for this blog series. Very helpful. I tried all the steps. But I got an error when trying to connect saying the password for the Keystore is incorrect. I do no’t remember setting this password. Can you help me here with what am I missing? Thanks.

    Keystore.PNGsa

    (0) 
    1. Ben Hofmans Post author

      Weird. Might be related to the previous issues you had with a corrupted download… not sure which other files might have been lost/corrupted.

      Some generic hints that might help (depends on Windows version and setup):

      • When unzipping and installing, choose short file paths, Windows has a limit on the max file path
      • Run installer and config tool with Administrator rights. Logging in as Admin is not enough ! You need to right click and select “Run as administrator”

      Oh, and if you want to give it a try to set the password again in “Configure SSL”: the default password for the keystore is “changeit”

      (0) 
      1. abhijit N

        Thanks a lot. changeit worked for me. But now I am getting not authorized error.  I tried to change the SDI_USER password. But even with trying with new password I still got this error. I did check authorizations carefully one more time. It is exactly as per the blog.

        SLT USer.PNG

        (0) 
        1. abhijit N

          I wanted to update you that I was able to resolve the issues around this topic. 

          1) Since I Did not have unzipping software on the machine I wanted to use DP agent. I unzipped it on another machine and then used Goole drive to upload and then download the files. DO NOT DO THIS. Somehow google drive corrupted/converted some files this made my life difficult.. I got rid of this approached and I was fine.

          2) I did uninstall the agent and did a clean install.  The DP agent installation part was successful. 

          2) Connecting Agent to HANA. I had some issues here. I was able to resolve those by adding a Application privilege to the user SDI_DP_AGENT sap.hana.im.dp.proxy::AgentMessaging.

          3) For HANA XS Agent user, we need to use  the userSDI_DP_AGENT Screen shot on this page it says SDI_DP_USER.  This one was easy but mentioning it just in case anyone else has this issue.

          Again. Thanks for all the help. Moving on to part 3 now ! Yey !

          (0) 
          1. Ben Hofmans Post author

            Thanks for your comments Abhijit. I made a few corrections in the blog above for 2 & 3 so that others will not run into this issue…

            (1) 
            1. Thallita Cardeal

              Hey Ben! I hope you are fine!!

              I am having the same problem: error 401 – not authorized

              How should I proceed? I have already reviewed the entire set of roles and privileges and I am following step-by-step the entire contents of the blog and it’s all right apparently …

              What can I do? Can you help me?

              Thank you very much in advance!

               

               

               

              (0) 
  5. Pankaj Singh

    Hi Ben,

    Great stuff, Thanks a lot for sharing.

    It might be silly but i am facing below issue.

    I followed all your step and completed till step 4 but i am facing one issue in 5th step,  Though i have java 7 / java 8 installed on my system and environment variable is set correctly.

    But all the time i end up with below error message. Any input would be a great help. Thanks

    javaerror.PNG

    Note: I had set the java path yesterday and with that i could install it but when i am try to replicate the same in other system. I getting above error.

    (0) 
    1. Ben Hofmans Post author

      You need to make sure the path to the java bin directory is added to your Windows PATH variable. A quick way to verify is to open a command windows (cmd.exe) and type java – version. If the windows PATH variable is set correctly, you will get a version number back. Once this works, also the HANA installer should be able to move forward…

      (0) 
      1. Pankaj Singh

        Hi Ben, Thanks for your response. yes, java path is set correctly and as you said, i am getting java version number back when i check for java -version in cmd. Please find the below screen shot of the same. Something very weird happening and i am not able to proceed. Thanks

        javaerr.PNG

        (0) 
        1. Ben Hofmans Post author

          OK, your JAVA setup looks correct indeed.

          Could it be a Windows authorization issue ? Can you start the installer by right-clicking and use “Run as Administrator” ?

          Ben.

          (0) 
          1. Pankaj Singh

            Thanks Ben, just to update you i am using windows desktop user to install it. And window user has admin privileges and as mentioned in blog i right-click and use “Run as Administrator”. But still i get the same error.

            Could it be a Windows authorization issue ? – Not sure if it’s something related to window user, any guess what could be the issue?

            (0) 
            1. Pankaj Singh

              One more thing Ben, Could you please explain below pointer in more details. I am using corporate network to install this.

              Your machine needs to be able to communicate to the internet. If you are within a corporate network, this will probably need to go through a proxy server, make sure you know the name and port for the proxy server you can use.

              (0) 
    1. Ben Hofmans Post author

      The delivery unit (DU) does not have an installer, you need to import this in your HANA database.
      The DP agent is a separate download after unzipping, you will see the .exe.
      For using SDI on HCP, you will need both the DP agent installed, as well as the DU imported into your HANA database.

      Thanks,
      Ben.

      (0) 
  6. Soumya Ranjan Das

    Hello Ben,

    I am facing the below issue while registering the agent. Kindly help. 

    Thanks & Regards, Ranjan

    Update:

    I registered directly in HANA Web Ide by using the below query:
    CREATE AGENT TEST_AGENT PROTOCOL ‘HTTP’;

    (0) 
  7. Ben Hofmans Post author

    Hi Soumya,
    Creating the agent with the CREATE AGENT statement like you mentioned in your earlier post, will not be sufficient to create an agent to use for HTTPS. There are other steps needed to make this work.  So I assume this is why you now get different errors.
    Better would be to go back to the previous error and try to make the agent registration work in the regular way.
    Some things to check:
    – Did you run the agent configtool with the windows option “Run as Administrator” ?
    – Does your version of DS agent and the DU you imported into HANA match (same SP level) ?

    I have not seen this particular error you mention, so don’t have a clear idea on what could be wrong.

    Thanks,
    Ben.

    (0) 
  8. Soumya Ranjan Das

    Hi Ben,

    I performed the steps again till step 5. I used SP02 DS agent and the DU.

    I faced the same issue , but after pressing the cancel button it shows that the agent is registered. Registering HanaAdapter still fails.

    Step 1:


    Step 2: Registering the Adapter

    Am i missing some steps?

    Thank you for your help!

    Regards,
    Soumya Ranjan

    (0) 
  9. Raghavendra SB .

    Hi Ben,

    This is nice document. I am able to create the remote and replicate the data.

    I am trying to create flowgraph with real time data replication, But i am facing some problem.

    I am getting error missing privilege for _SYS_REPO User.

    I am trying to give this privilege to _sys_repo, but getting error as Authorization issue.

    Please help me how to resolve this problem.

    Thanks
    Raghav

    (0) 
    1. Ben Hofmans Post author

      Hi Raghav,
      This blog comment is not the right place to ask general SDI questions. Could you use the Q&A section on the community for this ? This way, the answers will become visible to all community users and will be easier to find. I’ll try to answer the question there.
      https://answers.sap.com/index.html

      Thanks,
      Ben.

      (0) 
  10. Carsten Sandner

    Hello,

    In step 4 you say that I have to reset the passwords. Where I should login this Users to trigger the password change?

    My biggest problem is in step 5. I cant connect to the HANA Cloud.

    Update:
    We always get the error message ‚ÄúNo server is available to handle this request ‚Ķ Ensure that the ‚Äėxsengine‚Äô service is up and running on the HANA server.‚ÄĚ
    The HANA database is really running; we see that in the HANA studio. The HANA studio shows that all services of the HANA database are running, and no relevant alerts are displayed. The xsengine service was automatically configured to run in ‚Äúembedded‚ÄĚ mode, and presumably this xsengine is running normally within the HANA database. At least we do not see any direct alerts saying that the xsengine service was not running. But all attempts to connect the SDI agent to the running HANA datase fail with the above quoted error messages regarding the xsengine. How can this malfunction of the xsengine be overcome?

     

    (0) 
  11. John Fitzgerald

    Hi Ben,

     

    Its is indeed a well written blog. I was trying to setup real time replication with OracleLogReader. I keep runnning into this pesky error on the Cloud Platform Catalog page – when trying to access the remote source. I tried stopping and starting the agent, but it doesnt go away. I read somewhere about SSL certificates, but its not my strong point.

    10:35:04 AM (Catalog) Error reading Remote Object: InternalError: dberror(CallableStatement.execute): 403 – internal error: Cannot get remote source objects: exception 151044: Agent “my_DP_agent_ora” is not available.¬†

    Is this familiar? Provided below is the DPAgent  settings

     

    (0) 
  12. Daniel Chamorro

    Hi Ben

    Im getting de next error,  when try to connect to HANA:

     

     

    by clicking on the button “Update Status”, im getting the next message:

    Thank for your help.

    Regards.

    César.

     

     

     

     

     

     

    (0) 
  13. waseem pasha

    Hi Experts,

     

    I am unable to find below Application privilege roles while Assigning a roles to users:SDI_USER and SDI_DP_AGENT using a SYSTEM user.

     

    SDI_USER:

    Application privilege: sap.hana.im.dp.admin::Administrator

    SDI_DP_AGENT:

    Application privilege: sap.hana.im.dp.proxy::AgentMessaging

     

     

    Could you please suggest.

     

    Thanks,

    Waseem

     

     

    (0) 
  14. waseem pasha

    Hi Experts,

     

    Can any one please suggest.

    It could be due to Application privilege role issue am getting below error message Failed to connect to hana server with user SDI_user.

     

     

     

    Thanks,

    Waseem

    (0) 
    1. Ben Hofmans Post author

      The error looks pretty clear, no ? You will need to import the delivery unit first, before you can connect the agent. Importing the DU is explained in the first part of this step-by-step series.

      Thanks,

      Ben.

      (0) 

Leave a Reply