Skip to Content
Business Trends
Author's profile photo Mario De Felipe

Generative AI for SAP VI. Consume Amazon Bedrock through BTP Core AI

What are we doing today?

Leverage a generalized approach to applying Generative AI 🤗 to business challenges with SAP BTP. In this sample, we will deploy an SAP Cloud Application Programming application that interacts with Amazon Bedrock and does an RAG-based API search to federated data using SAP DataSphere.

What are we trying to solve?

Large Language Models are pre-trained on generalistic data and trained on past data. Still, they can both be helped to call external APIs, or they can query our own company data, and we leave the models to be the “language translators.” Hence, they get a good understanding of what the user wants and how the information is given back to the users.

One of the biggest problems of LLMs is they need as much data as possible and don’t consider the roles and authorizations the user has at the moment of the query. For this, we will leverage the SAP Identity Provisioning services from BTP to manage the identity lifecycle for SAP and non-SAP data for model prompting.


Components in use

1️⃣ SAP AI Core is part of the services portfolio that SAP BTP provides. It handles the execution and operations of the AI assets and integrates with our other SAP solutions. In our approach, we use SAP AI Core to act as a proxy to access the external Amazon Bedrock service and to expose a destination that can be consumed by our application.

2️⃣ Amazon Bedrock is a new fully managed service from AWS that makes base models from Amazon and third-party model providers accessible through an API. It’s cool because we do not need to control the model deployment or scalability; we just choose the model and interact with it through the API. Bedrock uses Agents 🤖 that invoke APIs dynamically to execute tasks. In this case, agents will call SAP BTP data services like DataSphere for federated queries or HANA Cloud for Graph queries over a Data Lake. Agents allow the native support for RAG to extend the power of FMs with SAP proprietary data

3️⃣ CAP Application. SAP recommends using Cloud Application Programming (CAP) as the entity layer of the application and SAP UI5 if a user interface is required to quickly build and deploy a front-end application

4️⃣ Pinecone Vector DB if the Agents for Amazon Bedrock need to connect to the company’s data sources, which have been transformed into embeddings and numerical representations. A Vector Database feeds a model with information in a way they understand.

5️⃣ SAP DataSphere. SAP Datasphere simplifies complex business data landscapes by unifying all data systems into a central layer.SAP Datasphere offers a variety of ways to collect or connect with data, regardless of where the data resides. It integrates with SAP applications and non-SAP systems to federate/replicate data across your most crucial data solutions—from lakehouses, data warehouses, data lakes, and data governance platforms.

Assigned Tags

      You must be Logged on to comment or reply to a post.
      Author's profile photo Tobi Aouad
      Tobi Aouad

      Hi Mario,

      Your blog series are amazing, I discovered them recently during the definition of an enterprise AI strategy for a customer who doesn’t use SAP. I come from an IBM/SAP background and would like to thank you for taking the time to generously share with us your experience.

      To help us better understand with another example of SAP AI innovations, Is it possible for you or someone else from SAP to share with us the SAP reference architecture for Process AI of SAP Signavio? This blog ( mentions the high level process but not with the details as in your amazing blogs.

      Thanks again for investing your time in helping others.




      Author's profile photo Mario De Felipe
      Mario De Felipe
      Blog Post Author

      Thank you Tobi!

      This 2023, there were two exciting sessions about Signavio Process Insights


      If you have access to PartnerEdge, there are other materials as well

      Author's profile photo Tobi Aouad
      Tobi Aouad

      Thanks Mario. I was hoping to understand the architecture they used to deliver this process AI innovation - similar to what you explain in your blogs , beyond the high level diagram included in that blog.