PI/XI: PI 7.3 processing of large files - teaser

[MichalKrawczyk]

In the past many companies used SAP PI not only for "real" integration scenarios that would require sender and receiver applications, mappings and complex routings but also for simple file transfers across folders or locations. Such simple transfers could be handled without SAP PI using different sorts of scripts but why use scripts if you have a nice middleware tool - SAP PI. Unfortunately SAP PI was not very strong with handling such files especially if they were very large. SAP PI would process the whole file at once and this caused many implications:

- the file could not be larger then the memory size
- handling of such big files caused other integration flows to run much slower

As of PI 7.3 SAP has prepared a remedy for this. It's now possible push via SAP PI all of your big files if you use special options available in the file adapter and they won't cause any negative side effects as they will be processed in small chunks. How does the configuration look like then?


Step 1

At first you need to make sure you're transfer will be EOIO (as only like that the chunks will not get mixed up).



Step 2

Make sure you've set the transfer up as Binary

Step 3

On the advanced tab select "advanced mode" and file splitting active and then choose the maximum size of a file part (in Mbs)




Once you configure that your huge files will be processed in smaller chunks which will not impact your other flows and the file size can now be almost unlimited 🙂

 Notes:

 - when you use this method you cannot use message mapping nor content based routing