Skip to Content
Product Information
Author's profile photo Laura Nevin

Spotlight: SQL on Files (SAP HANA Cloud, Data Lake)

As of the QRC 02/2021 release of SAP HANA Cloud, data lake, you can query files in your data lake file container that contain structured data without ever having to load the data into a database.

What is SQL on Files?

SQL on Files is a capability of the Data Lake Files service in SAP HANA Cloud, data lake that allows you to query files that contain structured data that are sitting in your data lake file container

As of the time of this writing, SQL on Files supports the following structured file formats:

  • Optimized Row Columnar (ORC)
  • Comma-Separated Values (CSV)
  • Apache Parquet

SQL on Files is considered a bridge between the Data Lake IQ and Data Lake Files components of SAP HANA Cloud, data lake.

When and why would I use this feature?

Use SQL on Files to lower the cost of analyzing large amounts of data of unknown value that is sitting in files.

SQL on Files allows you to perform some pre-exploration and data filtering on the data before moving aggregations of it, or all of it, into a database such as Data Lake, IQ, NSE disk storage, or SAP HANA Cloud, HANA database. You can even create views on the data.

You can also use SQL on Files in cases where you just want to keep the data in files so that other tools such as Apache Spark can access it.

How do I access this feature?

While SQL on Files is enabled by default in your SAP HANA Cloud, data lake instance, there are a few things you need to do before you can start using it.

  1. Follow the steps in this video, Data Lake Files and SQL on Files, to see how to configure your file container, set up authentication, and create a SQL on Files user in your SAP HANA Cloud, data lake instance.
  2. Add files to your file container using the steps found here: Adding Files to a File Container.
  3. Visit this topic to find the workflow you follow depending on your SAP HANA Cloud, data lake configuration (stand-alone vs. HANA DB-managed): Use SQL on Files.
  4. Query data in the files you added to the container using the steps found here: Queries Using SQL on Files.

Where can I find more information?

 

~ Happy squealing on files! ~

 

Assigned tags

      2 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo Ina Felsheim
      Ina Felsheim

      Be sure to check out www.sap.com/data-lake for details on SAP HANA Cloud, data lake.

      Author's profile photo Laura Nevin
      Laura Nevin
      Blog Post Author

      Great link, Ina; thank-you. I've also added it to the list of helpful resources in the post as well!