Skip to Content
Technical Articles
Author's profile photo Dhinesh Kumar R

Reprocess messages in SAP CPI using SAP API s and Without JMS provision

When working with CPI, we often wish there was an option to restart message as in SAP PI/PO, if it fails due to the target system unavailability or a glitch. There are already solutions provided for this using JMS provision and Data Store operations.

Since, JMS provision would require additional purchase and assuming that using data store operations for huge load affects tenant’s performance, we approached the solution in a different way using SAP CPI APIs.

This blog post explains about the approach to access payload stored in the tenant logs and retrigger it to the target system without any manual intervention and without storing the payload in a different storage. It also gives you an idea about the available SAP provided API s.


Resend the failed messages in CPI, due to target system unavailability or an exception.

Case Study:

The Customer data from C4C to SAP HYBRIS MARKETING System fails in CPI due to system unavailability .This required manual intervention to identify the customer whose data need to be resent which was quiet time consuming.


The below picture gives you an overview of our approach.

Let’s dive deep into the design and APIs used


The Flow 1 described in the above image is the actual IFLOW which will deliver the data received from C4C to SAP HYBRIS system via ODATA. The below steps are required to use this approach to retrigger messages in case of failures.

  • Use groovy Script to store the final payload being sent to the target system as an MPL Attachment.


              Sample Code:



                import java.util.HashMap;

             def Message processData(Message message) {

            def body = message.getBody(java.lang.String) as String;

            def messageLog = messageLogFactory.getMessageLog(message);

            if(messageLog != null){

                     messageLog.setStringProperty(“Logging#1”, “Printing Payload As Attachment”)

                     messageLog.addAttachmentAsString(“C4C_To_YMKT_Payload”, body,              “text/plain”);


             return message;



  • Add an exception sub process to the above IFLOW that will fetch the attachment ID of the payload in case of failures and write it to .CSV file in an SFTP folder


Once, the processing enters the exception subprocess. We do a GET request to SAP CPI API to retrieve the details of attachments. Let’s see more about each step in the exception subprocess

Request Reply 1:


This step is used to retrieve the Logs that contains the details of the attachments we store .

API used:  MessageProcessingLogs

Method:  “GET” /MessageProcessingLogs(‘{MessageGuid}’)/Attachments

This API is used to fetch the logs with details of all the attachments that are stored during the message processing.


URL format:


https:// /v1/MessageProcessingLogs (‘{MessageGuid}’)/Attachments”


QUESTION 1: So, where do I get the MessageGuid?


Below is the screenshot of logs for a message failure.

The Unique MessageGuid can be retrieved using camel expression from header “${header.SAP_MessageProcessingLogID}”


Below is an example of response for the above GET request

The response has the URI to access the attachment content stored in the tenant

All we need here is retrieve the value in the “ID” node as showed in the above screen shot and write it to .CSV file in SFTP.

Please, do replace all “:” in your attachment ID with “%3A” before writing to .CSV file.

Example: sap-it-res:msg:a83d5f88d:2254254a-8f3c-49b7-9fc9-ac3f3d856a2d

Should be written as “sap-it-res%3Amsg%3Aa83d5f88d%3A2254254a-8f3c-49b7-9fc9-ac3f3d856a2d” in your CSV file


Note: Since, our IFLOWS stores multiple Attachments.

We filter the ID of the only required attachment (final Outbound Payload) using a Mapping in the exception subprocess.



We have a separate IFLOW which would take the Attachment ID as input and access the attachment content, Push it to the Target system once the system is up.


  • STEP 1:

Fetch the .CSV file from SFTP that contains the list of Attachment IDS for the failed payload.

  • STEP 2:

Check if the file name is same as the file in which we stored the Attachment ID from FLOW1 using a router.If the condition is true, then the processing enter further steps else the file is sent as an attachment to team .

  • STEP 3:

Iterating Splitter to split each line from the CSV file ,then remove the line feed using Groovy Script and store the attachment ID in  exchange properties.


Code Sample :


function processData(message) {
var body = message.getBody(java.lang.String);

var map = message.getHeaders();
var value = map.get(“oldHeader”);
message.setHeader(“oldHeader”, value + “modified”);
message.setHeader(“newHeader”, “newHeader”);
map = message.getProperties();
value = map.get(“oldProperty”);
message.setProperty(“oldProperty”, value + “modified”);
message.setProperty(“newProperty”, “newProperty”);
return message;

  • STEP 4:

Do an ODATA call to the target system (in our case, its SAP HYBRIS MARKETING system) to      check if the system is up.

  • STEP 5:

On Successful response, send a GET request to API “MessageProcessingLogAttachments”

            URL FORMAT:

https://                      /v1/MessageProcessingLogAttachments(‘${property.ATTACHMENT_ID}’)/$value


https:// /api/v1/MessageProcessingLogAttachments(‘sap-it-res%3Amsg%3Aa83d5f88d%3A2254254a-8f3c-49b7-9fc9-ac3f3d856a2d’)/$value

  • STEP 4:

The retrieved payload is pushed back to the target system.


          NOTE: Exception Handling – AS, per your requirement.In our approach we are writing the attachment-IDs back to SFTP as a .CSV file with different name comparing to FLOW1.So, that this new file shall be sent via mail to the team when picked up by SFTP sender in FLOW2 and reprocessed with active monitoring to verify if the failure is due to a different exception other than Target systems unavailability.

Hence, from the above approach we could re-trigger a huge number of messages without storing the payload on a different source and expecting your expertise comments on how can we enhance this further

Assigned Tags

      You must be Logged on to comment or reply to a post.
      Author's profile photo Carlos García
      Carlos García

      Thanks for your article, is very interesting.

      The problem here comes when CPI itself cannot communicate with anything outside itself. In this case, it won't also be able to store anything in SFTP site. It would be great if "failsafe" info could be stored anywhere in CPI itself. Maybe using Bean in datastore could do the trick, but would impact on server's memory usage. It seems not to have an optimal solution 🙂

      Thanks and regards,

      Author's profile photo Chi Iong Ma
      Chi Iong Ma

      To be honest, I think CPI is a half baked solution with lots of missing functionalities that come with basic PI. With the current stage, I can't understand anyone will choose CPI instead of PI. Restarting a message is a basic button in PI which becomes rocket science in CPI.

      Author's profile photo Bruno Ceolin
      Bruno Ceolin

      This is a very narrow vision of the integration capability. Choosing CPI over PI (or vice-versa) is a strategic decision that has to take into consideration several aspects of your integration landscape.

      After 4 years working with HCI/CPI, I cannot see myself using PI/PO to integrate complex scenarios anymore. The flexibility that CPI brings is without question something that PO doesn't have, even with the BPM feature enabled.

      CPI is still missing some functionalities yes, but it doesn't prevent you to have an Enterprise-grade integration landscape.


      Author's profile photo Lukasz Grochal
      Lukasz Grochal

      We're trying to implement a similar scenario. We're making a call to retrieve the attachment ID from the exception subprocess. This call is failing though with status code 404 - {"error":{"code":"Not Found","message":{"lang":"en","value":"[IntegrationOperationServer][SECURITY][ObjectNotFound]:Object with ID AGNu0er8lLgIdwqhMvsuxxecA9ix not found."}}}

      It appears that the attachment ID's as well as the log itself is not yet committed in CPI and it cannot be retrieved. Once the flow fails though, I can call the CPI API and retrieve the attachment list without any issue.

      I also tried to figure out a way to get the attachment ID in a groovy script but it looks like we can only write to the log (e.g. create the attachment) but cannot read there (to get the attachment ID).

      Any ideas?



      Author's profile photo Mohd Mukheed
      Mohd Mukheed

      Hi Lukasz ,


      We can write the attachment id to custom header and retrieve it using MPL instead of logging in attachment i guess also can you provide me the sample groovy for the below,


      I also tried to figure out a way to get the attachment ID in a groovy script




      Author's profile photo Mohd Mukheed
      Mohd Mukheed

      Hi Dhinesh,

      I have similar requirement can you please help me with xsd file to upload in message mapping after http call to fetch attachment ids

      after the below call,

      https:// /v1/MessageProcessingLogs (‘{MessageGuid}’)/Attachments”

      have seen you are able to use message mapping post Request Reply iam not finding exact xsd to use message mapping,

      hope you get me