Skip to Content

Integrating Azure Storage Services in a Big Data Workflow with SAP BODS

February 5, 2018 | 610 Views |
Follow

Azure Storage Services are one of the oldest and now widely used Cloud based Storage solutions. They are used for storing ad-hoc flat files ranging from small bytes and scale up to petabytes which classifies them as “Big Data” Services. In this blog, we will explore how Enterprises can use these services as file stores and integrate them into their SAP BODS Workflow.

Mounting file storage in Windows Explorer

The Azure File Store can be mounted on to the system which BODS can read files from and write the output into. On the Azure File Store, create a New File Share to create a new File share or click on an existing one.

Integrating Azure Storage Services in a Big Data Workflow with SAP BODS - 1

You can connect the file share as a Network drive by using the Power Shell or regular windows command prompt. If you are running Linux, you can use CIFS to mount the drive. Click on connect button for the connection commands.

The drive letter should be the same for both the BODS Client and the Server. The service running the BODS services should have access to the mounted drive. Once you mount it, you should be able to see the drive in your Explorer.

Integrating Azure Storage Services in a Big Data Workflow with SAP BODS - 2

Accessing file store in BODS

The Mounted file store can be accessed in BODS by its mounted directory. Create a new local File location with the mounted directory.

Integrating Azure Storage Services in a Big Data Workflow with SAP BODS - 3

Now create a new Flat file. Select the location that was created in the above step and the File name inside the File Store.

Integrating Azure Storage Services in a Big Data Workflow with SAP BODS - 4

You can now use this in your Workflow as a Flat File for reading and writing Data. Some of the other benefits of using this are:

  • Since the Files are stored directly on the cloud, it can scale up in size as needed.
  • It can act as a backup storage for Staging files, logs, etc.
  • This can be used to consume large size files without having to waste space locally on the Server.

Next in this series, we will explore how we can directly use Cloud Services on BODS Workflow.

To report this post you need to login first.

4 Comments

You must be Logged on to comment or reply to a post.

  2. SNEHASISH GHOSH

    Hi Shankar,

     

    Can we use AWS S3 as a Target? I checked your other blog which suggested Azure can be used as a Target.

     

    Thanks,

     

    Snehasish

     

    (0) 

Leave a Reply