Skip to Content
Author's profile photo Lars Breddemann

HANA SPS 7 first dazzling highlights

Another half year passed and another SAP HANA SP has just been released.

SAP HANA 1.0 SPS 7 is out in the wild as revision 70.00 (double zero revision, yes Moneypenny 😉 ) and a lot of things had been changed, added and (hopefully) improved.

http://upload.wikimedia.org/wikipedia/en/9/9b/Miss_Moneypenny_by_Lois_Maxwell.jpg
(linked from here)

Don’t get me wrong, this is by no means a comprehensive “What’s new” report (for that, make sure to check the SPS 7 documentation as soon as it is out as well https://help.sap.com/hana_platform).
While the documentation is not yet completely available on help.sap.com make sure to check the built in online help in SAP HANA studio (reference guides).

Also, check out SAP note 1944771 for release information.

ATTENTION: one of the major changes is that from now on, there exist maintenance revisions that are developed besides the SP revisions.

The maintenance revisions shall only contain bug fixes and keep functionality stable.

As a consequence of that, the upgrade paths between maintenance and SP revisions must be obeyed.

Read SAP note 1948334: SAP HANA Database Update Paths for Maintenance Revisions for the details.

Finally, don’t miss out on the WEBCAST series “SAP HANA SPS7 – Overview, Features, Details

So this is what Ravi asked for – just quick glimpses

PlanViz changes

  • GUI improved

03-12-2013 23-53-01.png

There’s even the option to execute a query and displaying the result set.

  • aborted plans still visible

failed plan.png

That’s right, even though the query aborts with an error, you can review the PlanViz trace up until the POP that failed and analyze what was going on.

  • inverted index usage information (visible in the hover over details of POPs)

Thanks to my co-author, program lead and fellow Wuppertaler Richard from whom I stole this example…


Name: Basic predicate

ID: cs_plan13688_ld9506_30103_tableSearch1_pop1

Summary: MANDT = ‘800’

Execution Time (Self): 0 ms

Execution Time (Inclusive): 0 ms

Execution Start Time: 162,707 ms

Execution End Time: 162,707 ms

Estimated result size: 51

Estimation time: 0.067 ms

Inverted Index: not used

  • applied column filters (WHERE condition and analytic privileges) shown at the object where it is applied

search on table.png

Unfortunately there’s no time for now to do more tests – but I’m quite happy to see that so many improvement requests have been fulfilled (thanks for all the due follow up Mr. K!).

Session grouping, filtering and aggregation features

session filters.png

session  aggregates.png

Fancy graphical display of memory and resource allocation/usage

memory overview.png

Mhmm… I like pie…

resource overview.png

Impressive how these lines have different colors and go upwards…

Statisticsserver process now included in indexserver process

Yep, it’s not a separate process any longer, doesn’t have it’s own persistence any more and is much better configurable (that’s what I heard).

Details are to be found in SAP note 1917938.

As it’s not a very visual feature, here some trace file output line from the migration 🙂 …


 i STATS_CTRL       NameServerControllerThread.cpp(00203) : installing...
 i STATS_CTRL       NameServerControllerThread.cpp(00299) : old StatisticsServer: ld9506:34205, volume: 2
 i STATS_CTRL       NameServerControllerThread.cpp(00355) : waiting for start of old StatisticsServer ld9506:34205, volume: 2...
 i STATS_CTRL       NameServerControllerThread.cpp(00371) : waiting for old StatisticsServer ld9506:34205, volume: 2 to stop all operations...
 i STATS_CTRL       NameServerControllerThread.cpp(00373) : old StatisticsServer ld9506:34205, volume: 2 has stopped all operations
 i STATS_CTRL       NameServerControllerThread.cpp(00376) : old StatisticsServer is ready. starting...
 i STATS_CTRL       CallInterfaceProxy.cpp(00035) : sending install request
 i FileIO           FileStatistics.cpp(00287) : FileFactoryConfiguration::initial(path="/usr/sap/WUP/HDB42/backup/log/", AsyncWriteSubmitActive=auto,AsyncWriteSubmitBlocks=new,AsynReadSubmit=off,#SubmitQueues=1,#CompletionQueues=1)
 i STATS_CTRL       CallInterfaceProxy.cpp(00039) : response to install request: OK
 i STATS_CTRL       NameServerControllerThread.cpp(00299) : old StatisticsServer: ld9506:34205, volume: 2
 i STATS_CTRL       NameServerControllerThread.cpp(00422) : found old StatisticsServer: ld9506:34205, volume: 2, will remove it
 i STATS_CTRL       NameServerControllerThread.cpp(00425) : forcing log backup...
 i FileIO           FileStatistics.cpp(00287) : FileFactoryConfiguration::initial(path="/usr/sap/WUP/HDB42/backup/log/", AsyncWriteSubmitActive=auto,AsyncWriteSubmitBlocks=new,AsynReadSubmit=off,#SubmitQueues=1,#CompletionQueues=1)
 i STATS_CTRL       NameServerControllerThread.cpp(00430) : log backup done. Reply: [OK]
--
[OK]
--
 i STATS_CTRL       NameServerControllerThread.cpp(00433) : stopping hdbstatisticsserver...
 i STATS_CTRL       NameServerControllerThread.cpp(00458) : waiting 5 seconds for stop...
 i Service_Shutdown TREXNameServer.cpp(03734) : setStopping(statisticsserver@ld9506:34205)
 i STATS_CTRL       NameServerControllerThread.cpp(00463) : hdbstatisticsserver stopped
 i STATS_CTRL       NameServerControllerThread.cpp(00466) : remove service from topology...
 i STATS_CTRL       NameServerControllerThread.cpp(00470) : service removed from topology
 i STATS_CTRL       NameServerControllerThread.cpp(00472) : remove volume 2 from topology...
 i STATS_CTRL       NameServerControllerThread.cpp(00476) : volume removed from topology
 i STATS_CTRL       NameServerControllerThread.cpp(00478) : mark volume 2 as forbidden...
 i STATS_CTRL       NameServerControllerThread.cpp(00480) : volume marked as forbidden
 i STATS_CTRL       NameServerControllerThread.cpp(00482) : old StatisticsServer successfully removed
 i STATS_CTRL       NameServerControllerThread.cpp(00405) : removing old section from statisticsserver.ini: statisticsserver_array_BACKUP_LAST_DATA
[...]
 i STATS_CTRL       NameServerControllerThread.cpp(00405) : removing old section from statisticsserver.ini: statisticsserver_view_VOLUMES_OUT_OF_ORDER
 i STATS_CTRL       NameServerControllerThread.cpp(00409) : making sure old StatisticsServer is inactive statisticsserver.ini: statisticsserver_general, active=false
 i STATS_CTRL       NameServerControllerThread.cpp(00222) : installation done

New SQL functions

HASH_SHA256 –  “Returns a 32 byte VARBINARY hash value of the concatenated arguments. The hash is calculated using a SHA256 algorithm.

I guess that Jon and In-Sung Lee will like that

Alright, admit it: you also have to blink to believe that all that made it into SPS 7, right?

It’s nearly as if Xmas was coming up… wait a minute…

Cheers and a great holiday season everybody!

Lars

Assigned Tags

      25 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo Vivek Singh Bhoj
      Vivek Singh Bhoj

      Hi Lars,

      Its HANA 007 😉

      Thanks for sharing another great document.

      New features in Plan Viz are welcome esp inverted index usage

      Very colorful display of Memory usage - Lumira Pies

      Regards,

      Vivek

      Author's profile photo Kumar Mayuresh
      Kumar Mayuresh

      Hi Lars

      Thanks for the update on HANA 007 🙂

      Finally there is a document on HANA Performance Analysis 🙂

      Regards

      Kumar

      Author's profile photo Lars Breddemann
      Lars Breddemann
      Blog Post Author

      Hi Kumar,

      thanks and yep - just saw the document...

      What can I say... I'm not impressed 😏 .

      Well, seems there's still demand for some more explanation around this topic.

      Cheers, Lars

      Author's profile photo Former Member
      Former Member

      Hi Lars,

      feel free to update it! The document says "Version 1.0 - 27-11-2013". We are eagerly waiting!

      Regards,

      Mark

      Author's profile photo Lars Breddemann
      Lars Breddemann
      Blog Post Author

      Hehehe... let's see about it.

      Currently writing on something much bigger, so first things first!

      Maybe 2014 will see me writing even more. Who knows 😀 .

      Author's profile photo Kumar Mayuresh
      Kumar Mayuresh

      Hi Lars

      Awaiting for the bigger update, and at-least there is a document on performance analysis 😉 .

      I agree with you - over the content in the document.

      Regards

      Kumar 🙂

      Author's profile photo Former Member
      Former Member

      Thanks once again for introduction to SP7 in Bond style..... i loved it 🙂 🙂

      Regards,

      Kulwinder

      Author's profile photo Lars Breddemann
      Lars Breddemann
      Blog Post Author

      Awesome, up to now the comment section has an average of (2+2+1/3 =) 1,667 smileys which I consider pretty good for such a dry nerdy topic.

      If everybody is happy, how could I complain? 😀

      Cheers, Lars

      Author's profile photo Raj Kumar Salla
      Raj Kumar Salla

      Hi Lars,

      Thanks for SPS Bond updates. The term is nicely coined.

      Hope in couple of weeks in the discussion threads the person might mention "I am using Bond version" 🙂

      Regards

      Raj

      Author's profile photo Rama Shankar
      Rama Shankar

      Thanks Lars! 🙂

      Rama Shankar

      Author's profile photo Former Member
      Former Member

      is this on 1000+ GB RAM or is it just me?

      Author's profile photo Lars Breddemann
      Lars Breddemann
      Blog Post Author

      Sorry, but I don't get what you are referring to.

      Could you rephrase the question?

      Author's profile photo Former Member
      Former Member

      i had an impression that one of the graphics is showing a system with 1 033 961 MB physical memory, which if google calculates it correctly, comes down to 1 009.7 GB.

      that's almost 30 times more than we, mortals, can rent on aws.

      Author's profile photo Former Member
      Former Member

      uhm...15 times...

      Author's profile photo Lars Breddemann
      Lars Breddemann
      Blog Post Author

      Ah, I see 🙂

      Well, this system actually has one TB of RAM. It's a physical single node HANA server - about two years old.

      Author's profile photo John Appleby
      John Appleby

      Hey Lars,

      SP7 seems to bring some nice new things for us. Plenty of work to do of course for SP8 🙂

      John

      Author's profile photo Denys Kempen
      Denys Kempen

      Hi Lars,

      Thank you for the inspiration. Hope you don't mind I quoted you in the SAP HANA Academy blog on What's New with monitoring.  😉

      Denys

      Author's profile photo Ingo Peter
      Ingo Peter

      Hi Lars,

      Resource Utilization and Memory Overview seem to be rather secret features: I could never launch them - even not as system user in a freshly installed system:

      1.PNG

      Which privilege do I actually need?

      Regards,

      Ingo

      Author's profile photo Denys Kempen
      Denys Kempen

      Hi Ingo,

      All you need is the SAP HANA Academy. 😉

      See video

      Monitoring SAP HANA - Monitoring Role | SAP HANA

      Author's profile photo Former Member
      Former Member

      Hi Lars,

      Regarding:

      Statisticsserver process now included in indexserver process

      What was the stat server + index server peak memory utilization?

      what was the retention period set?

      Did you observed any OOM/Unloads on the master node after migration?

      We are having a big time issues with 72.

      Author's profile photo Lars Breddemann
      Lars Breddemann
      Blog Post Author

      Hi Srikanth

      After the migration there is no way to distinguish memory requirement of the statistics service from the other sessions running in the indexserver process.

      There is no separate statistics server process after the migration anymore.

      If you face issues due to this - actually the statistics service integration should help _reducing_ resource usage - please have support look into it.

      Besides that, rev 72 should be upgraded to the current maintenance revision for SPS 7: 74.02.

      - Lars

      Author's profile photo John Appleby
      John Appleby

      What we found matches what Lars says: integrated statistics server reduces memory consumption by 2-3GB.

      Also Rev.72, 73 were problematic - update to 74.2/80 which are better in many ways!

      If you get OOM are you sure you are not just low on memory?

      Author's profile photo Former Member
      Former Member

      2-3 Gig not gonna help, we have implemented retention procedure and set it to 7 days but we see a Stats process resident size of 90 to 120 gig.
      Hopefully after migrating to 80, we might see some improvement.

      Author's profile photo John Appleby
      John Appleby

      Sounds like you have a problem, best to take this up with OSS. It's tough to troubleshoot this sort of thing in a public forum!

      Author's profile photo Lars Breddemann
      Lars Breddemann
      Blog Post Author

      As long as you see a statistics server process you *don't* use the integrated statistics service.

      Not sure where this went wrong, but there really is no additional process left after the migration.