Skip to Content
Author's profile photo Joerg Aldinger

Service Layer Data Transfer Workbench… Imports just got a lot faster

As part of a large Business One project we had trouble using SAP’s Data Transfer Workbench because of the mere quantity of data involved. Memory management in DTW is not optimal and after several hours of running consumes almost 100% of RAM, slows down extremely and eventually stops responding altogether.

Meet the solution: Since the project was based on SAP Business One version for SAP HANA, we were able to leverage the possibilities of the Service Layer to import data massively and with minimal memory footprint on the machine importing the data.

To illustrate the difference, here are a few key pieces of information:

SAP B1 DTW CEO SLDTW
Technology used COM API (DI API) B1 Service Layer (HTTPS)
Libraries required .NET Framework, DI API, MS Access DB Engine .NET Framework only
Memory Consumption on client Starts at 200MB, grows to several GB after a few hours 110 MB steady, running 4 threads
Import speed Starts at approx. 3 records per second, eventually slows down to 0 12 records per second, running 4 threads

Here is a screenshot of our first version, running on an uncertified test server with much lower CPU power than a certified server:

SLDTW.png

Note that we also decided to not use any of the Microsoft ODATA libraries as suggested by the B1 solution architects. We instead built our own communication procedures using plain .NET functions.

Anybody interested in the tool can drop me a note, either right here on SCN or using our Facebook page: https://www.facebook.com/CEO.Consultoria

Looking forward to your comments!

Thanks,

Joerg.

Assigned Tags

      7 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo Former Member
      Former Member

      Dear Joerg ,

      Kindly I am interested in this tool can send me .

      Best Regards,

      Homsi

      Author's profile photo Marek Trzeciak
      Marek Trzeciak

      Hi Joerg,

      It sounds amazing.

      We have similar problem with DTW. Could you send me your tool please? I'm very interested on how it's gonna work in our environment.

      Regards

      Marek

      Author's profile photo Joerg Aldinger
      Joerg Aldinger
      Blog Post Author

      Please send me a private message or contact me through Facebook with your e-mail address included.

      Best regards,

      Joerg.

      Author's profile photo Marek Trzeciak
      Marek Trzeciak

      Hi Joerg,

      I've tried to conntact you on Facebook but I didn't get any response.

      My mail address is marek.trzeciak@computec.pl

      Author's profile photo Former Member
      Former Member

      What file types are you transferring? I see what is above are .txt. Will it do Excel files ?

      Thanks

       

      Author's profile photo Joerg Aldinger
      Joerg Aldinger
      Blog Post Author

      Not directly, no. You still have to copy and paste from Excel to text.

       

      Regards,

       

      Joerg.

      Author's profile photo Martin Tocauer
      Martin Tocauer

      Hi Joerg

       

      I´m very interested in this tool. Can you contact me about it.

      my best

      Martin