Example Parallelization based on table partitions
This example is referenced in my other post about parallelization. Please have a look at the other post to get a better understanding of the context for this example.
How to control parallelization in your model
Define start node for parallelization
To start parallelization in the Projection node “startParallelization” (1.), go to the Mapping dialog (2.), select the data source (3.) and open the properties (4.). In the properties, select “Partition Local Execution”
start parallelization in node “startParallelization”
Define stop node for parallelization
To stop parallelization in node “stopParallelization” open the details of the Union node “stopParallelization”, navigate again to the properties of the data source and set the flag for “Partition Local Execution”:
stop parallelization in node “stopParallelization”
With this setting every node between nodes “startParallelization” and “stopParallelization” will be executed in parallel for each partition of the data source table of node “startParallelization”. For simplicity only one node was inserted between the start and stop nodes of the parallelization block but you could have multiple nodes between the start and stop nodes.
Click here to navigate back to the context in which this model is used. You will also find examples there.