Technical Articles
DevOps with SAP BTP: Monitor & Operate
In this blog post, I will provide further insights on the offerings for the Monitor & Operate phase of SAP’s DevOps portfolio. It is an article in a series of blog posts, where I want to give more details on the portfolio of DevOps cloud services around SAP BTP. For an overview of the overall offering and all categories, start with this blog post.
In the Monitor & Operate phase, you make sure that your app running on SAP BTP is provided with the right performance and availability.
Local Native Monitoring
To assure that, you first need insights into the status of your app (including all used service and potential data flows), for which SAP BTP offers local native monitoring capabilities that allow access to health status information and metrics from the platform. For example, you can use the SAP BTP cockpit in the Neo environment to monitor Java and HTML5 applications or use the SAP Application Logging service in the Cloud Foundry environment that allows to access and analyze log files stored in the Elastic stack, such as via predefined Kibana dashboards pictured below:
If you need deep, full-stack monitoring of your cloud apps, consider third-party application performance monitoring solutions, such as from our partners Dynatrace and CA Technologies.
Alerting
Instead of manually tracking the monitoring information for your applications on an ongoing basis, we recommend to set up SAP Alert Notification service for SAP BTP, which allows to subscribe to events coming from the platform (such as from used services and SAP HANA Cloud) and can also handle custom alerts from your own applications, notifications from hyperscalers and from Dynatrace.
SAP Alert Notification service
Also DevOps services from SAP BTP, such as SAP Continuous Integration and Delivery service and SAP Cloud Transport Management service offer an out-of-the-box integration, such as to inform the team about pipeline runs or deployments to production.
These notifications can then be sent via a channel of choice – such as via email or to the slack channel/Microsoft Teams space of your DevOps team responsible for a certain app or for persistency. Also, you can forward alerts into SAP’s strategic operations platforms, as outlined below.
Technical Ops Automation
For reducing overall technical operations efforts of your DevOps teams, we are offering the SAP Automation Pilot service. This service allows to automate regular technical DevOps tasks in the lifecycle of your apps running on SAP BTP and to link them to key DevOps processes. For this, the service provides a catalog of pre-defined commands that can be triggered out of the context of other DevOps services. One example would be an alert that you configure in the SAP Alert Notification service, having directly in mind what would be the first task of the ops team to react on this kind of alert. With the SAP Automation Pilot service, you are enabled to directly configure a command that gets automatically executed when this alert gets triggered – think of automated execution of root cause analysis or an automated restart of your app or your database.
As part of the service, we provide commands along many relevant technical categories, such as for alert remediation, root cause analysis, database automation (such as restart, high-availability handling or automated update), or lifecycle management (such as before or after a certain transport handled by the SAP Cloud Transport Management service). With this high integration with other DevOps services and tasks, we see a major benefit for your DevOps teams, as they would be enabled to reduce efforts out of their relevant operations context.
Integration into Strategic Operations Platforms
SAP does offer different central strategic operations platforms for different target groups – they also support you to ensure business continuity in SAP-centric landscapes, potentially comprising SAP cloud solutions and existing on-premise backend landscapes. Here, it is key that also SAP BTP operations and observability aspects can be integrated smoothly into the broader operations capabilities those platforms do offer.
For example, in SAP Cloud ALM, you can receive alerts from the Cloud Foundry environment and notifications and exceptions from Neo (such as monitoring alerts) – sent by SAP Alert Notification.
An integration with SAP Automation Pilot allows you to trigger customized or predefined commands on SAP BTP via SAP Cloud ALM Operation Flows.
For more information on the available and planned scope of SAP Cloud ALM for operations depicted below, see the SAP Cloud ALM for Operations home page.
SAP Cloud ALM for operations – functional overview
In addition, the SAP Alert Notification service allows an out-of-the-box integration into SAP Solution Manager (described in this blog post) and SAP Focused Run. For example, if you should use SAP Solution Manager for your app management, also alerts from SAP BTP can come up in the Exception Management dashboard of SAP Solution Manager – which is especially attractive for hybrid applications, where you can get end-to-end transparency of the relevant on-premise and cloud parts and react on them accordingly with a holistic view (by assigning exceptions to the right team or bring up incidents).
This brings us to the general option to provide hybrid supportability of apps spanning both on-premise and cloud. Here, SAP Solution Manager and SAP Focused Run have several offerings, such as Integration Monitoring (allowing to ensure data flows in hybrid environments with SAP Integration Suite), User Monitoring, Trace Analysis, the already mentioned Exception Management, and many more.
Result
As a result of this phase, you have established efficient processes to ensure the availability and performance of your apps – by using the corresponding capabilities of the platform itself and by integrating them into higher-level, broader strategic operations platforms, as required. A high level of established alerting and automation capabilities should free up resources of your DevOps teams to focus more on innovation.
To optimize your DevOps tasks, procedures and efforts for handling the complete lifecycle of your apps on an ongoing basis, continue with the Automate & Optimize phase.
Hi Boris,
with the provided link to SAP Application Logging I was able to get performance data of my CAP sample application shown quickly in the Kibana dashboard. I've also was able to setup the autoscaling for this application. What I haven't found was the possiblity to send an alert when the CPU load or Memory consumption is above a certan percentage. I've only found Resource Quota Utilization Event. But that isn't the current CPU or Memory consumption. Is there a out-of-the-box way to integrate Applicaiton Logging with the SAP Alert Notification service?
Best regards
Gregor
Hello Gregor,
Thanks a lot for bringing up this valid question! Unfortunately, for the time being, there is no out-of-the-box way for alerts from these CF metrics - we are considering to provide improvements for our observability services that would then also allow a direct integration into SAP Alert Notification for these metrics, but the external availability of those improvements is not clarified yet. When discussing the current situation, our observability experts pointed out that they doubt that CPU/RAM utilization alerts will really be that helpful in modern cloud systems, as the CPU and memory values provided by the plain CF API are considered to be too coarse-grained.
But you might nevertheless want to get whatever is available to gain own experience. Therefore, until our road map is clarified, we could only point you to Dynatrace or to standard CF workarounds, such as by setting up an own metric persistency, exposing the relevant metrics, and automating on top via application/service endpoints with the cloud-native capabilities modern programing frameworks (such as spring boot) do provide.
We are aware that this is not optimal, but would be happy to discuss this in detail with you - please just ping me and I would be happy to set something up!
Thanks a lot,
Boris
Editorial comment: Done minor edits, updated overview pictures for SAP Alert Notification service and SAP Cloud ALM for operations
Thanks for amazing blog. Can you please help me understand role of SAP BTP Monitoring Service?
Where does SAP BTP Monitoring Service fits in BTP Monitoring ecosystem? Where should we use it?
Hi Vishal,
Thanks a lot for the kind feedback and your absolutely valid question! SAP Monitoring Service for SAP BTP can be integrated into ALM as well, as described here:
Also, the service can provide specific notifications on Neo, in addition to other services, like SAP Alert Notification service. With this, you can reach a wide range of monitoring and alerting for different KPIs and use cases.
I hope this helps to get the holistic picture!
Thanks again + best regards,
Boris