Skip to Content
Technical Articles
Author's profile photo Former Member

Data Intelligence & Pandas – Part 1

Objective of this Blog

The primary objective of writing this blog is to cover how these operations can be reused in other operation like Data Cleansing , Preprocessing etc.

 

Assigned tags

      4 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo James Giffin
      James Giffin

      This is a nice overview of the flexibility of Data Intelligence. While there is nothing wrong with the approach, I would recommend simplifying the graph by using the Read File operator and passing the data to your custom logic. This gives you even more control and makes the graph easier to read/maintain in the future without digging into the custom operator logic.  Especially if you have large files on the DI_DATA_LAKE or other file storage, you can split the work into batches or parameterize the reads to make the operator more generic for more use-cases.

      Author's profile photo ASHUTOSH SHRIVASTAVA
      ASHUTOSH SHRIVASTAVA

      Good work

      Author's profile photo Leon Williams
      Leon Williams

      Thank you for this great article.

       

      mypascoconnect

      Author's profile photo Indu Khurana
      Indu Khurana

      Hello, I can not see the article, it's displaying just an introduction statement. thanks.