SAP Commissions – Smart Data Integration[SDI] – Part 7a

Dear All,

This article is intended for database admins, consultants, customers & partners to enable the File Adapter  & configure sample data from your local file path to load into your SDI Project

In this blog, we are consuming the data provided by customer (extract & dump regularly) in the local path where DP Agent is installed. Few customers may not connect to their local database (source) due to privacy & security.

Register the agent

You will use the command-line tool to configure the data provisioning agent to connect to your SAP HANA instance using a secure connection.

Open a command line or terminal with administration rights.

For Windows, search for cmd and use the context menu to choose Run as Administrator.

Refer this blog to start DP Agent

Agent Registration

and follow the instructions to register your local computer as an agent.

Finally, register an adapter using option 8.

Use FileAdapter when prompted. Use Quit to exit the configuration agent.

Configure an access token

From a command prompt, use the following command to set an access token.

agentcli --setSecureProperty

Set a token and make a note of it. example you can use FileToken

or you can enter your own choice but you should be remembering token you entered which will be needed in last Step configuring the Remote source

Press Enter and quit the configuration tool.

Prepare a file for upload

Download this sample file into the default workspace.

The default workspace is located in <<ROOT DIRECTORY>>\workspace, for example, \usr\sap\dpa\workspace

Create a text file called salarydata.cfg with the following content:

#Configuration file for data load
CODEPAGE=UTF-8
ERROR_ON_COLUMNCOUNT=false
ESCAPE_CHAR=\
EXPONENTIAL=E
FORCE_DIRECTORY_PATTERN=C:\usr\sap\dataprovagent\Datafiles
FORCE_FILENAME_PATTERN=salarydata.csv
FORMAT=CSV
LENIENT=true
LOCALE=en_US
ROW_DELIMITER=\n
SKIP_HEADER_LINES=1
COLUMN=id;INTEGER;
COLUMN=salary;INTEGER;
COLUMN=start_year;INTEGER;
COLUMN=gender;NVARCHAR(256);
COLUMN=region;NVARCHAR(256);
COLUMN=T-Level;NVARCHAR(256);

Save the configuration file in the same directory.

Create a Remote Source

Go back to the Database Explorer. You will see the adapter under Catalog -> Agents

You should see the agent you registered.

Right-click on Remote Sources. Choose Add Remote Source

Choose FileAdapter

Call the source LocalFile. The Source location should automatically choose the agent you registered on step 4.

Set the path to the workspace directory in which you downloaded the CSV file

Scroll down to the credentials and choose Technical User as the credentials mode and enter the access token in the AccessToken field. If you used the example token before, enter FileToken.

Click Create

Check the remote objects to make sure configuration has been successful and to complete the validation below.

Create a Virtual Table

you will have to create a Virtual table by connecting to your remote source to load the data into table.

CREATE VIRTUAL TABLE ext.VT_testing_yoga AT "testing_yoga"."<NULL>"."<NULL>"."salarydata";

you can preview your data if that’s coming from local file

References

SAP Commissions – Smart Data Integration[SDI] – Part 1

SAP Commissions – Smart Data Integration[SDI] – Part 2

SAP Commissions – Smart Data Integration[SDI] – Part 3

SAP Commissions – Smart Data Integration[SDI] – Part 4

SAP Commissions – Smart Data Integration[SDI] – Part 5

SAP Commissions – Smart Data Integration[SDI] – Part 6

SAP Commissions – What I wish I had known about Smart Data Integration[SDI]