Skip to Content
Author's profile photo Niki Scaglione

ChunkMode for Binary File Transfer within PI 7.1 EHP1

While playing with  PI 7.1 EHP1 I found an interesting feature that can easily support file-to-file transfer scenario especially dealing with big file size. The feature is only available for file-to-file scenario using EOIO quality of service. The feature is named ChunkMode and it enables splitting binary sender files into fixed “chunks” in order to process big file without affecting J2EE engine of PI system.

Even if this feature seems to be not yet mentioned into SAP NetWeaver PI 7.1 EHP1 documentation page, the screenshot below shows the additional attributes of Adapter Metadata File into PI 7.1 EHP1 not present into PI 7.1 version one.

 

Adapter Metadata

 

To enable ChunkMode, at first, set the Quality of Service to Exactly Once In Order with a specified queue name for the sender communication channel then set the advanced mode of the channel and define the Maximum Size[MB] for the chunks. As  receiver communication channel no relevant options must be configured.

 

CC_Processing

 

CC_Chunk_size

 

For testing the solution just create an Integrated Configuration object to define a scenario using sender and receiver communication channel before mentioned. In the test I did, some files were placed inside one ftp server and then processed successfully using EOIO with chosen queue name as shown in the pictures.

 

 FTP

 

 Communication Channel Detail

 

Finally I did some tests tuning chunk size of sender communication channel, and that is  the summary of processing time for the qualitative test done.

 

Test result

That’s all.

Assigned Tags

      11 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo Laxman Molugu
      Laxman Molugu
      Thanks for sharing this information, do you know JMS adapter has the same functionality?

      Thanks,
      Laxman

      Author's profile photo Niki Scaglione
      Niki Scaglione
      Blog Post Author
      Hello,

      I checked Adapter metadata for JMS without finding any link to chunkmode functionality.

      Kind Regards,
      Niki

      Author's profile photo Former Member
      Former Member
      It is not a native function of the JMS adapter, but with the help of the header parameters you can make sure a split message (chunks delivered for example from any Seeburger adapter which about all allow to split on sender channel) can be sent to the JMS server and re-combined in the correct order there.

      You do not even need EOIO for that transfer as recombining chunks is a standard functionality for many JMS servers.

      The example where I have seen this in action was (99% sure) Seeburger AS/2 Sender to JMS Receiver adapter connecting to WebSphere MQ.

      With the file adapter now allowing splits, you might be able to do the same thing out of the box with standard SAP functionality.

      Author's profile photo Former Member
      Former Member
      Hello,

      This looks like a cool option to have even before 7.3 but do not seem to see this option in my File Adapter metadata. I am on PI 7.11 SP03.
      Also it is strange as SAP is one of the promotion points for PI 7.3 is to allow processing if big files. If it was already available in 7.11 then they would have not mentioned it in 7.3.

      Can you please confirm?

      Thanks,
      Yash

      Author's profile photo Niki Scaglione
      Niki Scaglione
      Blog Post Author
      Hi,
      I tested this feature on PI 7.11 SP3 as shown in the blog. Try to have a look to metedata (search for chunkmode).
      Kind Regards,
      Niki
      Author's profile photo Former Member
      Former Member
      No luck even with the search in the metadata :(.

      Can you give me your mail id and i can send a screenshot of the search i have done on the adapter metadata?

      Any other issue you can think of?

      Rgds,
      Yash

      Author's profile photo Shabarish Vijayakumar
      Shabarish Vijayakumar
      Cant really find this option in PI 7.11 SP03.
      Could you confirm this since the information might be misleading.

      Hope you understand.

      Regards,
      Shabz

      Author's profile photo Niki Scaglione
      Niki Scaglione
      Blog Post Author
      Hi,
      Yes, I find this option in PI 7.11 SP03
      Kind Regards,
      Niki
      Author's profile photo Shabarish Vijayakumar
      Shabarish Vijayakumar
      mystery solved by importing the 7.11 SP3 Sap Basis Content in to the ESR. Seems this was out of date 🙂
      Author's profile photo Niki Scaglione
      Niki Scaglione
      Blog Post Author
      Hi,
      Thank you for feedback.
      Kind Regard,
      Niki
      Author's profile photo Former Member
      Former Member

      Hi

      Please let me know if this option could be implemented on 7.11 Production environments. As confirmed by SAP seems this is available from 7.3 only. Please advice. Thanks in advance

      Uma