Skip to Content
Author's profile photo Former Member

SAP HANA 1.0 enables breakthrough Data Management with In-Memory Computing Engine

The SAP in-memory computing engine that resides at the heart of SAP HANA is an integrated database and calculation layer that allows the processing of massive quantities of real-time data in main memory to provide immediate results from analyses and transactions.

Like any standard database, the SAP in-memory computing engine supports industry standards such as SQL and MDX but also incorporates a high-performance calculation engine that embeds procedural language support directly into the database kernel. This approach is designed to eliminate the need to read data from the database, process it and then write data back to the database.

Technical Proof Points Show Unprecedented Results With Customer Data
The SAP in-memory computing engine delivers technical breakthroughs at the most fundamental levels such as CPU core utilization and massively parallel processing across nodes. “Working with large customer data sets from the beginning helped tremendously to speed up the development process,” said Dr. Hasso Plattner, co-founder of SAP and chairman of the SAP Supervisory Board. Through this work with customers during the SAP HANA pilot phase, SAP has been able to demonstrate fundamental improvement in three areas:

  • Speed: The SAP in-memory computing engine uses an in-memory columnar store to achieve breakthrough performance in scan, grouping and aggregation operations that are the heart of analytics. It has the ability to scan 2 million records per millisecond per core and over 10 million complex aggregations calculated on the fly per second per core. These results were attained with real customer data running on standard Intel processors. This performance has the potential to transform business processes. For example, as part of a consumer product goods customer proof of concept, SAP has implemented a real-world scenario on SAP HANA that demonstrates the ability to perform arbitrarily complex queries on over 450 billion records in a matter of seconds. Update, insert and data load performance also shows dramatic improvement relative to traditional systems, as no aggregates or database indices are maintained and all runtime data operations are conducted in memory with only logging executed against high performance solid-state disk (SSD) drives. In insert- only mode, the data base is lock free and can run multiple insert threads. In addition to the columnar store, the included row-store provides high transactional performance for small, read-only tables and single-row inserts.
  • Scalability: The core engine of SAP HANA has been designed ground-up around a multi-core architecture and implements dynamic parallelization and dynamic partitioning, for both OLAP and OLTP workloads, via adaptive, cache-aware algorithms. As a result, performance scales linearly across not only blades but the number of cores per blade. Current analyses indicate full parallelization at 1,000 cores and beyond. In addition, extensibility is much easier as new attributes can be added on the fly. The implications are clear: a future- proof technology that will continue to provide breakthrough price performance as server core density continues to increase exponentially.
  • Compression: Lastly, the SAP in-memory computing engine employs advanced compression algorithms and data structures that minimize the memory footprint required to run the system while still maintaining full support for OLTP workloads. The same 450 billion record system referenced above was implemented on less than three terabytes of physical memory. In addition, several application concepts, such as ageing, can be used to achieve further compression in-memory.

In-Memory Computing Engine and Native In-Memory Applications to Transform Enterprise Software Industry
“In addition to providing breakthrough value in analytics, the in-memory technology in SAP HANA enables entirely new applications that solve previously unaddressed problems,” said Dr. Vishal Sikka, Executive board member, Technology and Innovation, SAP AG. “By combining new software development techniques and programming models with design-thinking, beautiful new products at unprecedented speeds are now possible.” SAP has used its market-leading understanding of how enterprise applications interact with the database to consolidate key parts of the application layer such as business logic and object frameworks. This optimization is reflected in further substantial performance gains. For example, during the SAP HANA pilot phase, SAP has implemented core application scenarios such as Dunning with a 1,200x improvement in performance. Many customer application scenarios that currently take over two or three hours are now running in less than two or three seconds.

The SAP in-memory computing engine contains an integrated programming environment that allows the easy creation, inclusion and extension of native business functions that can be defined in a variety of languages such as SQL scripting, C++ and in the near future, Project R and Java Script. The SAP in-memory computing engine offers a unified information modeling design environment and can access data from both non-SAP and SAP sources. Thus, the optimization and simplification the SAP in-memory computing engine provides does not come at the cost of flexibility.

For more information visit the in-memory homepage on SDN, and watch the following TechEd Live interviews:

Follow in-memory computing technology and SAP HANA on Twitter at @SAPInMemory, and join the conversation at #hana, #inmemory and #sapteched.

Assigned Tags

      7 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo Tom Cenens
      Tom Cenens
      Hello Karin

      Nicely bundled information in this blog. Thanks.
      HANA is a very interesting topic.

      Kind regards

      Tom

      Author's profile photo Former Member
      Former Member
      Blog Post Author
      Thanks Tom.

      Stay tuned. We have a lot planned for January and February next year.

      Best,
      Karin

      Author's profile photo Graham Robinson
      Graham Robinson
      This blog seems to be more like a Press Release. Maybe that is where it should have been posted?

      Cheers
      Graham Robbo

      Author's profile photo Ethan Jewett
      Ethan Jewett
      Graham,

      In case you are interested, here is the German version of this blog: http://de.news-sap.com/2010/12/01/sap-hana-1-0-sorgt-fur-durchbruch-im-datenmanagement-durch-in-memory-computing-engine/

      Yes, it is a press release 🙂

      Ethan

      Author's profile photo Former Member
      Former Member
      As soon as I saw the copyright sign ® in the title, I knew there is something fishy about this blog. I love to hear news about HANA, but unfortunately there were no new technical details given.
      Author's profile photo Former Member
      Former Member
      Blog Post Author
      Hi Mark,

      I better delete the ® 😉

      I got a lot of general questions for in-memory and SAP HANA. That is why I thought I'll make it available to the SDN community. However, we have planned a technical blog series already and also plan for some real developer stuff. So please stay tuned.

      Best regards,
      Karin 

      Author's profile photo Former Member
      Former Member
      Blog Post Author
      Hi Graham,

      yes you are right - it is a technical press release. Since it is focussing on the technical basis, I thought I'll make it available to the SDN community together with all interviews the experts have given at all TechEds.

      In addition, there is a real technical blog series planned and also some more developer related stuff. So please forgive me that I shared some more overview information. I get a lot of questions on general and basis stuff right now, that is why I thought that might be useful.

      Stay tuned, there is a lot of cool stuff planned.

      Karin