Skip to Content
Technical Articles
Author's profile photo Roland Kramer

SAP ILM with SAP IQ Database

Last Changed: 27th of September 2021

SAP ILM with SAP IQ Database

Blog Content


Manage information through its lifecycle while balancing cost, risk, and compliance.

Streamline your IT infrastructure and protect the privacy rights of your consumer data with the SAP Information Lifecycle Management (SAP ILM) component. You can automate data archiving and retention, as well as the decommissioning of legacy systems, while balancing the total cost of ownership, risk, and legal compliance.

SAP ILM Framework

While the nearline storage functionality for the SAP Analytical (OLAP) based Systems like SAP BW and BW/4 with SAP IQ Database is well established, the usage of the SAP IQ Database for the general storage of BLOB, ILM-controlled archive files and archive indexes from transactional (OLTP) Systems like R/3, ERP or S/4 Data is also suitable option to use.

So let’s optimize the SAP ILM Store Setup with the experiences and strengths of the SAP-NLS Implementation known from SAP BW and BW/4.

Keep in Mind that SAP IQ is not the primary Database here, where the Application Data is stored, it is the secondary Database where the mentioned Objects from above stored for anytime fast access outside the primary Database for shrinking the main Database, e.g. SAP HANA. SAP IQ can compress the SAP HANA Data up to 80% in size due to the column based compression logic.

Blog from Mark Mumy (SAP)Should you archive both BW (or BW/4HANA) and ERP (pre-S/4HANA) on the same instance of SAP IQ?
Answer – Note 3085053 – Landscape Considerations for NLS and ILM


SAP ILM – Documentation and Information

SAP ILM Detailed Presentation (PDF)

SAP%20ILM%20Origins

SAP ILM Origins

SAP ILM HelpSAP ILM Implementation GuideNW ILM Store

SAP Customer Activity Repository (CAR) – Install and Set Up Integration with SAP IQ

must seen Blog from Neenu Susan George (SAP)ILM Store Configuration

Note 2705663 – Collective information regarding ILM (Information Lifecycle Management)

despite of SAP ILM or SAP-NLS, it is all about the SAP IQ Database Setup
Note 3017355 – SAP IQ 16.1 SP04 PLx – correct SAPIQDB.cfg settings
Note 3094594 – Enable SAP IQ for DBACOCKPIT

Note 3085053 – Landscape Considerations for NLS and ILM

 

The IQ implementation is the same as for NLS, so the following Note is relevant for ILM as well.
Note 2780668 – SAP First Guidance – BW NLS Implementation with SAP IQ

From an IQ License perspective, ILM needs the same license options (bundled) like the NLS use case (technically speaking)
Note 2372218 – Requisite IQ licenses for SAP-NLS solution – SAP BW with SAP IQ Nearline-Storage

However, getting a working ILM License for IQ needs the following options (separately purchased):

IQ_CORE – SAP IQ Enterprise Edition/AS Platform Edition (res. 4 Core)
IQ_UDA – SAP IQ Unstructured Data Analytics Option (usage)
IQ_UDF SAP IQ Unstructured Data Analytics Option (usage)
IQ_VLDBMGMT – SAP IQ Very Large Database Management Option (max. 4TB)


Just for the Record: the following SAP Notes are obsolete/not necessary, when the SAP IQ Database is installed in the mentioned way above. (Components BC-SYB-IQ,  BC-ILM-STO)

Note 2161052 – ILM Store: Free connection types
Note 2257318 – ILM Store: Lock Exception using IQ
Note 2284492 – ILM Store: Message “Connection limit exceeded” on IQ
Note 2414314 – IQ: PUT succeeds, GET fails with Row not found
Note 2478703 – ILM Store – IQ: Put Succeeds, GET fails with Row not found for the Streaming Case
Note 2634053 – SAP ILM and Sybase IQ storage
Note 2705663 – Collective information regarding ILM (Information Lifecycle Management)
Note 2748058 – During ILM storage “DETERMINE_PUT_TARGET” error occurs in SLG1
Note 2785785 – DAP ends with IQ Error SQL-131 Syntax error near ‘(end of line)’
Note 2806115 – Error binary data not supported on data longer than 32767 Bind host variable – SAP ILM and IQ
Note 2942648 – ILM store: error during storage of files with size greater than the streaming size
Note 2969212 – ILM : Error while deleting documents from ILM store set up as remote content repository

these are some corrections in relation to SAP IQ (Components BC-CCM-ADK, BC-ILM)

Note 3010127 – Dump CX_ILM_STOR_EXCEPTION during report RILM_STOR_TEST_PF_SINGLE
Note 3010305 – IQ: Structure tables are not filled on SAP IQ during setup of inactive infostructures
Note 3017579 – DBACOCKPIT: Monitoring multi sys using the SQL Statements cockpit action
Note 3020979 – ILM Store : Performance improvements during the file retrieval process

Update June 2021 – Improvements when testing the ILM Functionality

Note 3020979 – ILM Store : Performance improvements during the archive file read process


SAP IQ Database Setup for ILM

Consolidate Your Archived Data on SAP Sybase IQ

Blog – Q – the easy Installer for SAP IQ (for the Installer contact roland.kramer@sap.com)
Installation of the SAP IQ Database with three Values, only SDA/ODBC Setup needed.

Q%20-%20the%20easy%20SAP%20IQ%20database%20installer

Q – the easy SAP IQ database installer

smart%20data%20access%20%28SDA%29%20for%20SAP%20ILM

smart data access (SDA) for SAP ILM

Report%20ADBC_TEST_CONNECTION

Report ADBC_TEST_CONNECTION

the is one little addition to the DBCO setup of the ILM Store.

DBCO%20Values%20for%20ILM

DBCO Values for ILM


SAP IQ Monitoring with DBACOCKPIT

Blog – How to keep Enterprise Flash Applications accessible in 2021

dbisql -c "uid=SAP<SID>USR;pwd=Sybase4me;eng=<server>_<SID>_<nr>;dbn=SAPIQDB" -nogui
(DBA>) 
sp_displayroles;
sp_iqdbspaceobjectinfo USER0001;

necessary%20user%20roles%20for%20SAPSIDUSR

necessary user roles for SAP<SID>USR

tx.%20DBACOCKPIT%20-%20define%20the%20SAP%20IQ%20Database

tx. DBACOCKPIT – define the SAP IQ Database

tx.%20DBACOCKPIT%20-%20SAP%20IQ%20Database%20availability

tx. DBACOCKPIT – SAP IQ Database availability

tx.%20DBACOCKPIT%20-%20overview%20SAPSQ205%20IQ%20Database

tx. DBACOCKPIT – overview SAPSQ205 IQ Database

tx.%20DBACOCKPIT%20-%20SAPSQ205%20IQ%20Database%20Options

tx. DBACOCKPIT – SAPSQ205 IQ Database Options

tx. DBACOCKPIT – SAPSQ205 – IQ Database Tables


Setup SAP Information Lifecycle Management

First of all, you have to activate the SAP ILM Business Function with tx. SFW5 or maintain with tx. SFW2

SAP Help – Prerequisites for Using the ILM Store

Please Note, you have to use a Web based Method to do changes in the Business Framework. you can use the WebGUI for that task.
Note 2563024 – ILM Store – Collection of Notes

activate the ILM Database Store (ILM_STOR)

For the ILM Store usage there are several SAP Roles available. For a detailed description and the use of the authorization objects, you can refer to the ILM Implementation Guide.

Roles%20for%20the%20usage%20of%20ILM

Roles for the usage of ILM


Configuration of the SAP ILM Framework

as already mentioned, we are focusing here only on the usage of the SAP IQ Database together with ILM (no Azure BLOB, Hadoop or NFS will be covered).

Note 2563024 – ILM Store – Collection of Notes
Note 2243603 – ILM Store: Utility for adding Connection IDs to Class Factory

create an Entry in the Table TILMSTOR_CF for the created SAP IQ Database with the Report RILM_STOR_CF_DBCON

Table: TILMSTOR_CF
Interface: IF_ILM_STOR_DB_OPERATOR
for SAP IQ: CL_ILM_STOR_DB_OPERATOR_IQ

Report%20RILM_STOR_CF_DBCON%20for%20DBCON

Report RILM_STOR_CF_DBCON for DBCON

SM30 – Table TILMSTOR_CF

Please Note, the Customizing Settings for the tx. SARI and SARA are only available, when the activation of the SAP ILM Business Function was successfully.

customizing%20tx.%20SARI

customizing tx. SARI

customizing%20tx.%20SARA%20-%201-2

customizing tx. SARA – 1-2

customizing%20tx.%20SARA%20-%202-2

customizing tx. SARA – 2-2

Note 2544517 – Archive administration: Direct navigation to ArchiveFileBrowser

tx.

tx. AS_AFB (SARA)



Define the Origin Concept for SAP ILM

Origin%20Concept

Origin Concept

The Origin supports the ILM Store in determining the data origin and is a central element of the configuration of the ILM Store. Basically you define in this two Transaction from were the Data is coming from, and were it will be stored. In our Case of course the defined SAP IQ Database.

Details of creation the Origin can be found in the ILM Implementation Guide. Additional hints can be found in the Blog from Neenu Susan George ILM Store Configuration

Note 3068508 – ILM Store downport activity for customizing transactions

  • ILM_STOR_ADM_CUST (ILM Store Administrative Customizing)
  • ILM_STOR_OPR_CUST (ILM Store Operational Customizing)
  • Report RILM_STOR_GENERATE_CUSTOMIZING (ILM_STOR_GEN_CUST)

tx.%20ILM_STOR_GEN_CUST

tx. ILM_STOR_GEN_CUST

tx

tx. ILM_STOR_ADM_CUST

tx. ILM_STOR_OPR_CUST

tx SM30 – Table TILM_STOR_CUS

tx. SM30 – Table TILM_STOR_O_ROUT

tx. SM30 – Table TILM_STOR_CUS_O

TILM_STOR_CUS_P

tx. SM30 – Table TILM_STOR_CUS_P



Setup and Publishing of the SAP ILM Store

Details of the Publishing of the ILM Store  can be found in the ILM Implementation Guide.
Additional hints can also be found in the Blog from Neenu Susan George ILM Store Configuration

  • tx. SICF (HTTP Service Hierarchy)
  • tx. SM59 (RFC Destination)
  • tx. ILMSTOREADM (access with WebGUI)

Note 3027603 – Error “401 Unauthorized” in ILMSTOREADM while adding an ILM Store
Note 3044246 – “500 Internal server error” in LMSTOREADM while creating ILM Store

to publish the storage system using an ICF node, the SAP Backend must be correctly configured for the HTTP/S usage as described in the Documents. Some of the ILM Transaction are “hard coded” as HTTPS calls.

tx. SMICM

tx. SM30 – Table HTTPURLLOC

Note 2704178 – The error HTTP 500 “Redirect is not possible” occurs in /sap/public/myssocntl or in /sap/public/bc/icf/logoff
Note 2846151 – WEBGUI: “No OK code 200 in response from server.” when uploading large files

tx. UCON_CHW

tx. SICF – 1-2

tx. SICF – 2-2

tx. SM59 – S4H_ILM_STORE

tx.%20SM59%20-%20test%20the%20RFC%20connection

tx. SM59 – test the RFC connection

tx. ILMSTOREADM (access with tx. WebGUI)

If the Administration Origin is specified in Table TILM_STOR_O_ROUT, then the creation of the ILM Store will fail with the following message:

597%3A%20Inconsistent%20configuration

597: Inconsistent Configuration (CX_XADK_DAS_SERVER)

If this error arise, you can already run the mentioned check Reports RILM_STOR_TEST_PF_REPEAT_SMALL and RILM_STOR_TEST_PF_REPEAT_BIG (the message might be misleading)

598%3A%20Input%20or%20output%20error

598: Input or output error (triggered during access to file system, WebDAV or data stream)

"SQL message: [IQ Error SQL-141:42S02][SAP][ODBC Driver][SAP IQ]Table 'TILM_STOR' not found".

597: Inconsistent configuration
CX_XADK_DAS_SERVER
DA Service Message: _DEFINE_ARCHIVE_STORES: Store S4H_400_ILM_IQ Does Not Correspond to ILM Conformance 2

598: Input or output error (triggered during access to file system, WebDAV, or data stream; see long text)
CX_XADK_DAS_SERVER
DA Service Message: _DEFINE_ARCHIVE_STORES: Store SAP_ILM_STORE Does Not Support the WebDAV Log

 

Some of the Transaction are Web based, so access them via the WebGUI

### used Services in the HTTP hierarchy - tx. SICF
/sap/bc/webdynpro/sap/irm_policies
/sap/bc/webdynpro/sap/ilm_audit_area
/sap/bc/webdynpro/sap/das_store_browser
/sap/bc/webdynpro/sap/ilm_store_admin
/sap/bc/webdynpro/sap/wdr_test_input

Note 2970651 – Transaction ILM_SB does not work (but calling ILM Store Browser in different ways is successful)

ILM – selected access via WebGUI



Testing the ILM Functionality with IQ

for the testing of the ILM functionality, there are various Report’s available, which more less show a successful result or errors which are not related to the Solution. Additional checks can also be found in the Blog from Neenu Susan George ILM Store Configuration and – ILM Store Troubleshooting

  • RILM_STOR_TEST_HC_CLIENT (ILM Store: Health Check for Client Configuration)
  • RILM_STOR_TEST_AT (Validation of BC-ILM 3.0)
  • RILM_STOR_TEST_PF_SINGLE (only for file based archiving)
  • RILM_STOR_TEST_PF_REPEAT_SMALL
  • RILM_STOR_TEST_PF_REPEAT_BIG
  • RILM_STOR_TEST_CLEAR (needed to reset the Test Loop)
  • RILM_STOR_WD_DEMO (test of the WebDAV Layer)
  • RSARCH_CHECK_CUSTOMIZING

Report RILM_STOR_TEST_HC_CLIENT

Report

Report RILM_STOR_TEST_AT

Report RILM_STOR_TEST_CLEAR

Report RILM_STOR_TEST_PF_SINGLE

Report RILM_STOR_WD_DEMO

Report RSARCH_CHECK_CUSTOMIZING



SAP ILM – 1st Step Done …
 

Ok., that was a Hell of a Ride

Nevertheless, this is another proved Example of SAP (Sybase) IQ Multi Purpose Database.
It is true: SAP (Sybase) IQ – the hidden treasure …



Roland Kramer, SAP Platform Architect for Intelligent Data & Analytics
@RolandKramer

 

“I have no special talent, I am only passionately curious.”

Assigned tags

      4 Comments
      You must be Logged on to comment or reply to a post.
      Author's profile photo Emanuele Bucci
      Emanuele Bucci

      Hi Roland.

      Thanks for your post! It is really a great document, with a lot of valuable information.

      We are activating SAP ILM on a CRM system to archive BPs in compliance with the GDPR.
      We cannot use an external or remote database, but we would like to store the data to be archived possibly in the same Application Server.
      Here is my question: is the activation of the ILM Database Store (ILM_STO) business function mandatory or optional? in practice, is it possible to configure SAP ILM without activating the ILM_STO business function?

      As an alternative to SAP IQ, do you think the use of the file-system on the same application server can be a valid and fast option, or does it always require the assistance of the Basis?

       

      Best regards,
      Emanuele

       

       

      Author's profile photo Roland Kramer
      Roland Kramer
      Blog Post Author

      Hello Emanuele Bucci,

      In any case, you have to activate the Business Function ILM_STO despite if you want to use IQ, file system or Azure Bobs or something else.

      nothing beats the IQ Database in terms of performance like the other mentioned options.
      see the Blog - SAP (Sybase) IQ – the hidden treasure …

      on request, there is the possibility to use the easy IQ database Installer
      Q – the easy Installer for SAP IQ

      Best Regards Roland

      Author's profile photo Chad Sanders
      Chad Sanders

      Roland Kramer ... nice write up. Definitely something to consider in the world of ILM archiving.

      Author's profile photo Roland Kramer
      Roland Kramer
      Blog Post Author

      Thanks Chad, that was my intention with this Publication ... 😉 Best Regards Roland