Skip to Content
Author's profile photo Former Member

Processing Multiple Files simultaneously using BODS

Synopsis: This will be a step by Step tutorial on reading multiple files simultaneously using a single file format.

Two tab delimited flat files of identical format are available. They need to be extracted using BODI and the data needs to be pushed to the same table. The files source_1.txt and source_2.txt as shown in the below diagram are taken for demo purpose.

/wp-content/uploads/2013/03/sources_2_192504.jpg

In the file format, mention both the file names separated by comma.

/wp-content/uploads/2013/03/file_format_2_192505.jpg

Using this file format, data from both the file formats are extracted at one go.

/wp-content/uploads/2013/03/df_2_192510.jpg

Similar Options: A filename containing a wildcard character can also be used to read multiple files. In the above example, instead of using “source_1.txt, source_2.txt” as filename, you can also use “source_*.txt” to extract multiple files with similar naming convention.

Assigned Tags

      7 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo Former Member
      Former Member

      Debapriya,

      Thanks for the post, your example similar to what we do daily in our development environment. We are calling 44 text files using wild characters *.txt in filename field from a folder. Records of all the files are output to a table in sql server before transformation.

      Arun

      Author's profile photo Former Member
      Former Member

      Hi Debapriya,

      Thanks for the blog. I did not know about this option. I got to know about a new point.

      Vasuki.

      Author's profile photo Former Member
      Former Member

      Hi Priya,

      Thanks for the Post, it is good Example ..

      I have one Question for you..

      I saw the BODS 3.0/4.0  Service packs, Can you please let me know what is the BODS 4.0 SP1,SP2,SP3 and SP4. It is added any new contents BODS 4.0 Service packs..

      Please replay me ASAP..

      Thanks,

      Krishna..

      Author's profile photo Former Member
      Former Member

      It is good topic..

      Author's profile photo Former Member
      Former Member

      Good.

      Merge transform also does the same thing but it is a good replacement of it.

      Thanks for demo.

      Neha Khetan

      Author's profile photo Sandeep Kumar
      Sandeep Kumar

      Thanks for the post.

      Author's profile photo Former Member
      Former Member

      Hi DebaPriya,

      My Source is .CSV File and i have taken the faltfile format.

      There i have given the root path and the filename in the first time it is asking me for "OVERWRITE THE CURRENT SCHEMA WITH THE SCHEMA FROM THE FILE YOU SELECTED"  after 2 days i have taken the another file but this time it is not asking for the schema overwriting.

      Could you please assist me on this one.

      Thanks,

      Ramachandra.