Skip to Content
Technical Articles
Author's profile photo Geetha Madhuri Bobbili

Part 1: SAP Cloud Platform Integration for Data Services (CPI-DS)

Author: Geetha Madhuri Bobbili
LinkedIn Profile: https://www.linkedin.com/in/geetha-madhuri-bobbili-971268184/

Introduction:

SAP Cloud Platform Integration for data services allows you to efficiently and securely use ETL (extract, transform, load) tasks to move data between on premise systems and the cloud.

SAP Cloud Platform Integration interacts with your local SAP landscape via the SAP Data Services Agent and secure HTTPS and RFC connections. SAP ERP Systems are registered with the HCI Agent as data stores via RFC.

Before you can use SAP Cloud Platform Integration, your administrator needs to prepare your environment.Agents:

The SAP Data Services Agent provides connectivity to on-premise sources in your system landscape.

At design-time, the agent is used to provide metadata browsing functionality for on-premise sources to the web based user interface. At run-time, the agent manages the secure data transfer from your on-premise sources to your cloud-based target application.

Agent groups ensure high-availability by clustering one or more agents and making sure tasks and processes get assigned only to available agents in the group.

Download & Install the Agent:

Create a New Agent, download the configuration file (AgentConfig.txt).

Select Agents tab -> Click on “New Agent”.

Enter the Name and Description for the Agent. Select the Agent Group.

An agent group is a collection of agents that are logically grouped. When scheduling or running tasks and processes, an agent group is specified. At run-time, tasks and processes are automatically assigned to an available agent within the group.Download the Configuration File. Save the configuration file in your local system where you want to install the agent.After downloading the Configuration file, select Save and Close. Once you click on Save and Close, you can see the Agent Information under the group “GBOBBILI”.Install above agent by right click on it and run it with elevated/admin rights.After the above step, you will see below screen. You need to provide your Windows credentials and password over there and click install.

After clicking Install button you will see below screen click finish and YES.

Then you will see below screen. Provide your credentials of CPIDS and password. Attach the AgentConfig.txt file and provide the proxy host & port and then click Upload and yes.

Login to CPIDS (from the above link) and check if the agent is active or not.

Create Datastore:

Datastores are the objects that connect SAP Cloud Platform Integration for data services to your cloud and on-premise applications and databases.

Through these connections, SAP Cloud Platform Integration for data services can access metadata from and read and write data to your applications and databases.

Within the Datastores tab, you can create and manage datastores, which connect SAP Cloud Platform Integration for data services to your applications and databases.

From this tab, you can:

  • Create and delete datastores
  • Test the connection to a datastore
  • View and edit a datastore’s configuration options (Configuration)
  • Browse a datastore’s metadata objects (File Formats or Tables)
  • Import and manage file format or table metadata objects for a datastore
  • View data loaded to a table in a target datastore to ensure it is correct

Select Datastores tab -> Create “+” icon to create New Datastore.

SAP CPI – DS supports datastores the following types of applications and databases:

  • SAP Business Suite applications
  • SAP BW sources
  • SAP HANA application clouds
  • SAP HANA cloud applications such as SAP IBP and SuccessFactors BizX
  • Applications that have pre-packaged or user-written adapters
  • Databases
  • File format groups
  • SOAP and REST Web services

Once the Datastore is created Test the connection.

Import Metadata Objects:

Importing metadata objects adds the table and file names from your source and target databases and applications to your datastores.

In the Datastores area, select a datastore.

Open the Tables or File Format tab (which one appears depends on the datastore type).

Do one of the following:

If the datastore has a Tables tab, click Import Objects or Import Object by Name and select the tables whose metadata you want to import. (To import a web service object, the web service must be up and running.)

If it has a File Formats tab, click Create File Format and select the option you want to create.

Select the Type of Meta data to be imported and enter the Name.

Table: A table is a collection of related data held in a table format within an SAP (or non-SAP) system. It consists of columns, and rows.

Extractor: An extractor is a pre-defined SAP program that gathers data from various tables in an SAP source system (typically SAP ECC) then processes this data to create specific business content for insertion into another SAP system (such as SAP BW or SAP IBP).

Function: An SAP Function (or Function Module) is a pre-written custom program that typically extracts data from an SAP system and writes this to output fields or tables (that can be read by SAP CPI-DS).

Once the table meta data is imported we can see the column Names and data types in details tab, as shown below.

Create the Target Datastore by following the above steps and import the target table meta data.

Conclusion:

Now we have imported the Source and Target tables metadata. In Part 2 of the blog series, we will create Tasks, Processes, and Projects in SAP CPI-DS.

Reference:

https://help.sap.com/

Assigned Tags

      18 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo Michael Mack
      Michael Mack

      Great start. I like it. Can't wait to read part 2!

      Author's profile photo Geetha Madhuri Bobbili
      Geetha Madhuri Bobbili
      Blog Post Author

      Thank you Michael 🙂

      Author's profile photo Manish Gupta
      Manish Gupta

      Well articulated blog 👍🏻👍🏻

      Author's profile photo Yogesh Narwani
      Yogesh Narwani

      Very Well Articulated ! !

      Author's profile photo Geetha Madhuri Bobbili
      Geetha Madhuri Bobbili
      Blog Post Author

      Thank you Yogesh 🙂

      Author's profile photo Sibi Sivakumar
      Sibi Sivakumar

      A Good blog to start with !

      Author's profile photo Geetha Madhuri Bobbili
      Geetha Madhuri Bobbili
      Blog Post Author

      Thank you Sivakumar 🙂

      Author's profile photo Parvaiah Kale
      Parvaiah Kale

      Thank you. Very informative and detailed. I could easily co-relate with sap data services designer functionality. Nice blog!

      Author's profile photo Geetha Madhuri Bobbili
      Geetha Madhuri Bobbili
      Blog Post Author

      Thank you Parvaiah 🙂

      Author's profile photo Shubha Nand
      Shubha Nand

      Hi Geetha/All

      Its a informative blog.

      We are trying to find out

      1. how we can migrate SAP Data Services on premise to SAP Cloud Platform? Is this possible?
      2. Also, how the jobs are migrated from on-prem to cloud platform?

      Please provide some inputs.

      Thanks,

      Shubha

      Author's profile photo Maruthi Anumula
      Maruthi Anumula

      Nice Explanation.

       

      May I request you what is the future CPI-DS roadmap

      Author's profile photo Ali ABUDEEB
      Ali ABUDEEB

      Hello Geetha, great blog. I have a quick question, what is the difference between CPI DI and CPI DS? Cant CPI DI perform the same function?

      Author's profile photo Ibrahim Adejoh
      Ibrahim Adejoh

      Thank you.

      Well articulated

      Author's profile photo Marcelo Morais
      Marcelo Morais

      Excellent blog!

       

      Can you confirm if CPI is now part of BTP?

       

      Thanks!

      Author's profile photo Shamik Rakshit
      Shamik Rakshit

      Impressive Documentation with full of information

      Author's profile photo PATILJIDNESHA PATILJIDNESHA
      PATILJIDNESHA PATILJIDNESHA

      Do you have any pointers for connecting EDL (Enterprise Data Lake) to CPIDS?

      Author's profile photo yogesh raut
      yogesh raut

      Hi Geetha,

      Very good article on integration of SAP IBP with on-prem server.

      Can you please share some insight on SAP IBP integration with S/4HANA cloud server (not on-prem)? is there any different method to integrate cloud-based S/4HANA server with SAP IBP?

      Thanks & regards,

      Yogesh

      Author's profile photo Sumanth Siddavatam
      Sumanth Siddavatam

      Hi Geetha,

       

      Excellent blog! Thank you for this.

       

      We are also trying to setup CPI DS. SAP CPI DS is now part of SAP BTP and I am having hard time finding the agents page.

       

      Could you please share the URL or the path from where I can download the agent.

       

      Thanks & Regards,

      Sumanth