Data Transfer transform benefits
Data Transfer transform can be used to move data from a source or from another transform into the target datastore.
- Data Transfer transform will push down the operations to database server when the transfer type is a database table.
- It enables a full push-down operation even if the source and target are in different data stores.
- This can be used after query transforms with GROUP BY, DISTINCT or ORDER BY functions which do not allow push down.
However, Data Transfer transform is best suited only when the data volume is huge. If the data volume is less, its usage will not provide much difference in performance.
Also the way data transfers work depends on the scenario. When a look up is used and in the subsequent query transform if ‘Group By’ is used, then after the look up, the data transfer can be used. But when there are no resource- intensive operations being used, usage of Data Transforms will not provide much of an advantage.