Skip to Content

In my last blog-post I covered Package Size & Impacts of Package Size in DTP. Continuing the same trend of DTP, I am about to write on a topic discussed on SCN forum on & off. I intent to write this blog-post because I myself struggled with knowing the exact way of how the processing of data with allocated processors happens inside a DTP & which is the best available mode. After deep understanding, I thought of writing a blog-post on this very interesting topic. Let’s start.

To start with, there are 3 modes of data processing available in DTP which are listed as below:-

1. Parallel Extraction & Processing

2. Serial Extraction & Immediate Parallel Processing

3. Serial Extraction & Serial Processing

Let us get into details one-by-one.


1. Parallel Extraction & Processing :

As the mode-name suggests, it actually extracts the data & process the data parallel i.e. simultaneously. In this mode, all available processes extract the data parallel & as soon as extraction is completed the data processing starts. Here data processing is updating the data to the target. In this mode, there is a possibility that one process might be updating the data packet to the target, while others might still be extracting. Hence, the work is done parallel.

SAP also refers this processing mode as P1.

Example: If we assign 6 parallel processes then each process extracts one data packet at a time & updates the same data packet to the target. Hence, in this case 6 data packets will be processed simultaneously & updated to target accordingly. This process continues till the end of all packets available.

2. Serial Extraction & Immediate Parallel Processing :

When we select this mode for data processing, the process extracts the data from source & after complete extraction, the data packet is processed by another process. In the meantime the 1st process again starts extracting another package. And the cycle continues.

Now, here if the 1st processor has not completed extracting the 1st package yet then a new process will start extracting depending upon the number of parallel processes assigned/allocated. Hence, as the name suggests it serially extracts the data from source & as soon as extraction is finished the packet is processed & updated to target.

SAP also refers this processing mode as P2.


Example: If we have 6 processes assigned for this mode then one process will do the extraction of packets one by one & other processes will do the processing & updating to target parallel. As explained above if 1st process is still extracting then 2nd process will jump in for extraction of next packet. This procedure takes place serial extraction & is further processed parallel.

3. Serial Extraction & Serial Processing :

In this mode only one processor firstly extracts the data packet from source & then the same processor will update the data packet to the target without involvement of any other processor. Once the data packet extraction from source & update to target is finished, the processor moves to next data packet.

This processing mode is rarely used because of performance optimization issues & is not recommended generally.


SAP also refers this processing mode as P3.


Example: As we cannot allocate or define maximum number of background processes for this mode it is obvious that one processor will extract & update while other will do other jobs. 


Summary & Performance Comparison:

Although the selection of Processing Mode in DTP depends upon the combination of Data Source, Transformations/ Mapping & Data Target the selection of processing mode should be smart enough to optimize the performance of DTP. Based upon above information, I can state that P1 has better performance over P2 & P3 whereas P3 has the lowest performance over P1 & P2.


Hope this blog helps you in understanding how the processing of data from extracting data from source to processing it to updating it to data target is done in DTP by the  processing types.


Author: Shubham Vyas

Company: Mindtree Ltd. (Bangalore/India)

Created on: 27 June 2015










To report this post you need to login first.

6 Comments

You must be Logged on to comment or reply to a post.

  1. Matthew Billingham

    What your blog doesn’t do is go into any detail about which you would use when, the pros and cons of each, any potential issues lurking, your personal experiences etc. I think “deep understanding” is overstating it a little.

    (0) 
    1. SHUBHAM VYAS Post author

      Hi Matthew,
      By deep understanding I meant about how processing is done in DTP in different modes. I have seen discussions on SCN asking the difference between the types of mode & how they work.
      Also, I will update the post as per your suggestions.

      Thank you for stopping by,
      Shubham Vyas

      (0) 
  2. Mario Tibollo

    you might also want to explain why not all the different data processing are available in every dtp. In some cases you don’t have any choice. It’s nice to explain that there are different options, but tell us why the choice is sometimes limited.

    M.

    (0) 
  3. Anshu Lilhori

    I don’t think you have shared anything new or unique here.This has been already covered in detail and in-depth. A simple search would yield n number of documents covering the same topic.

    So in  my eyes its not adding any value to the community.

    Regards,

    AL

    (0) 
  4. Raf Boudewijns

    this seems to be the case for BW7.0 (just checked the help on that version), however I’m seeing other types in our BW7.3 system (and soon we’ll be on BW7.4 so I’ll probably be seeing yet some other types as well), so my advice: it’s always wise to specify your version…

    (0) 

Leave a Reply