Skip to Content
Author's profile photo Louis de Gouveia

SAP DS Load data into Google Big Query


In my post SAP Data Services 4.2 SP4 New Features I highlighted some new functionality introduced in Data Services 4.2 SP04. One of the new functionality was the ability for Data Services to load data into Google Big Query. This blog focuses on how you can do that.

Google Big Query Setup

To get started with Google Big Query you need to


  • You will then be taken to project overview page. You will see option “Try BigQuery”. Click on it.


  • You will be taken to a page where you can compose a query. There is sample tables that you can query. As seen below a query has been created against one of the sample tables. Once run it shows the time and mb processed.


  • We now need to also sort out authentication. Navigate here


  • Select the following options. When you click “Create Client ID” it will create an authentication file. Save the file, this is in json format, this is not the file we need. If using chrome it will save in downloads automatically.


  • Also on the credentials screen  you will have more info as seen below. Click “Generate new p12 Key”, save this file as we need this when creating the datastore in DS. When you generate the key a popup will been show and will have a pass phrase. Write this pass phrase down. We need this to create the datastore in DS also.


  • You will also need to setup the trial, you cannot create a table without a trial. DS can only load so we need a table to be created.


You now have everything you need to create a datastore in data services.

Data Services Google Big Query Datastore

You can now create a datastore in Data Services Designer. The only pars you need to fill in is the parts in the red. All the other parts are there by default. The fields you need to enter come from the Google setup part we did above.


You can now load data to Google Big Query.

Hope this helps.

Assigned Tags

      You must be Logged on to comment or reply to a post.
      Author's profile photo mic grasso
      mic grasso

      Hi I'm having a few issues , looks like Google Console UI has changed quite a bit since this post ..please see the new UI steps  here

      any ideas?

      Author's profile photo Pan Cheng
      Pan Cheng


      I am able to create the connection to Google Cloud. However i am not able to load the data from a table into Google Big query. Its giving exception. Its plain extract from a table into google big query table and its giving exception saying

      job_extract_flat_ger_emp_mgr|DATAFLOW df_extract_emp_mgr_file|STATEMENT LOAD MESSAGE DS_Google_Cloud..emp_mgr INPUT Could not find transform <emp_mgr>. Ensure that it exists.

      Author's profile photo Titto Antony
      Titto Antony

      Hi Pan,

      Did you resolve this issue. I'm facing a similar issue in DS 4.2 SP 7.

      Author's profile photo Pan Cheng
      Pan Cheng

      Nope. We are not able to resolve it in DS4.2 SP7. SAP told us to upgrade to 4.2SP8