SAP ILM with SAP IQ Database
Last Changed: 27th of September 2021
SAP ILM with SAP IQ Database
- SAP ILM – Documentation and Information
- SAP IQ Database Setup for ILM
- SAP IQ Monitoring with DBACOCKPIT
- Setup SAP Information Lifecycle Management
- Configuration of the SAP ILM Framework
- Define the Origin Concept for SAP ILM
- Setup and Publishing of the SAP ILM Store
- Testing the SAP ILM Functionality with IQ
- SAP ILM – 1st Step Done …
Manage information through its lifecycle while balancing cost, risk, and compliance.
Streamline your IT infrastructure and protect the privacy rights of your consumer data with the SAP Information Lifecycle Management (SAP ILM) component. You can automate data archiving and retention, as well as the decommissioning of legacy systems, while balancing the total cost of ownership, risk, and legal compliance.
While the nearline storage functionality for the SAP Analytical (OLAP) based Systems like SAP BW and BW/4 with SAP IQ Database is well established, the usage of the SAP IQ Database for the general storage of BLOB, ILM-controlled archive files and archive indexes from transactional (OLTP) Systems like R/3, ERP or S/4 Data is also suitable option to use.
So let’s optimize the SAP ILM Store Setup with the experiences and strengths of the SAP-NLS Implementation known from SAP BW and BW/4.
Keep in Mind that SAP IQ is not the primary Database here, where the Application Data is stored, it is the secondary Database where the mentioned Objects from above stored for anytime fast access outside the primary Database for shrinking the main Database, e.g. SAP HANA. SAP IQ can compress the SAP HANA Data up to 80% in size due to the column based compression logic.
SAP ILM – Documentation and Information
SAP Customer Activity Repository (CAR) – Install and Set Up Integration with SAP IQ
From an IQ License perspective, ILM needs the same license options (bundled) like the NLS use case (technically speaking)
Note 2372218 – Requisite IQ licenses for SAP-NLS solution – SAP BW with SAP IQ Nearline-Storage
However, getting a working ILM License for IQ needs the following options (separately purchased):
– IQ_CORE – SAP IQ Enterprise Edition/AS Platform Edition (res. 4 Core)
– IQ_UDA – SAP IQ Unstructured Data Analytics Option (usage)
– IQ_UDF – SAP IQ Unstructured Data Analytics Option (usage)
– IQ_VLDBMGMT – SAP IQ Very Large Database Management Option (max. 4TB)
Just for the Record: the following SAP Notes are obsolete/not necessary, when the SAP IQ Database is installed in the mentioned way above. (Components BC-SYB-IQ, BC-ILM-STO)
Note 2161052 – ILM Store: Free connection types
Note 2257318 – ILM Store: Lock Exception using IQ
Note 2284492 – ILM Store: Message “Connection limit exceeded” on IQ
Note 2414314 – IQ: PUT succeeds, GET fails with Row not found
Note 2478703 – ILM Store – IQ: Put Succeeds, GET fails with Row not found for the Streaming Case
Note 2634053 – SAP ILM and Sybase IQ storage
Note 2705663 – Collective information regarding ILM (Information Lifecycle Management)
Note 2748058 – During ILM storage “DETERMINE_PUT_TARGET” error occurs in SLG1
Note 2785785 – DAP ends with IQ Error SQL-131 Syntax error near ‘(end of line)’
Note 2806115 – Error binary data not supported on data longer than 32767 Bind host variable – SAP ILM and IQ
Note 2942648 – ILM store: error during storage of files with size greater than the streaming size
Note 2969212 – ILM : Error while deleting documents from ILM store set up as remote content repository
these are some corrections in relation to SAP IQ (Components BC-CCM-ADK, BC-ILM)
Note 3010127 – Dump CX_ILM_STOR_EXCEPTION during report RILM_STOR_TEST_PF_SINGLE
Note 3010305 – IQ: Structure tables are not filled on SAP IQ during setup of inactive infostructures
Note 3017579 – DBACOCKPIT: Monitoring multi sys using the SQL Statements cockpit action
Note 3020979 – ILM Store : Performance improvements during the file retrieval process
Update June 2021 – Improvements when testing the ILM Functionality
|Note 3020979 – ILM Store : Performance improvements during the archive file read process|
SAP IQ Database Setup for ILM
the is one little addition to the DBCO setup of the ILM Store.
SAP IQ Monitoring with DBACOCKPIT
dbisql -c "uid=SAP<SID>USR;pwd=Sybase4me;eng=<server>_<SID>_<nr>;dbn=SAPIQDB" -nogui (DBA>) sp_displayroles; sp_iqdbspaceobjectinfo USER0001;
Setup SAP Information Lifecycle Management
SAP Help – Prerequisites for Using the ILM Store
Please Note, you have to use a Web based Method to do changes in the Business Framework. you can use the WebGUI for that task.
Note 2563024 – ILM Store – Collection of Notes
For the ILM Store usage there are several SAP Roles available. For a detailed description and the use of the authorization objects, you can refer to the ILM Implementation Guide.
Configuration of the SAP ILM Framework
as already mentioned, we are focusing here only on the usage of the SAP IQ Database together with ILM (no Azure BLOB, Hadoop or NFS will be covered).
create an Entry in the Table TILMSTOR_CF for the created SAP IQ Database with the Report RILM_STOR_CF_DBCON
Table: TILMSTOR_CF Interface: IF_ILM_STOR_DB_OPERATOR for SAP IQ: CL_ILM_STOR_DB_OPERATOR_IQ
Define the Origin Concept for SAP ILM
The Origin supports the ILM Store in determining the data origin and is a central element of the configuration of the ILM Store. Basically you define in this two Transaction from were the Data is coming from, and were it will be stored. In our Case of course the defined SAP IQ Database.
- ILM_STOR_ADM_CUST (ILM Store Administrative Customizing)
- ILM_STOR_OPR_CUST (ILM Store Operational Customizing)
- Report RILM_STOR_GENERATE_CUSTOMIZING (ILM_STOR_GEN_CUST)
Setup and Publishing of the SAP ILM Store
- tx. SICF (HTTP Service Hierarchy)
- tx. SM59 (RFC Destination)
- tx. ILMSTOREADM (access with WebGUI)
to publish the storage system using an ICF node, the SAP Backend must be correctly configured for the HTTP/S usage as described in the Documents. Some of the ILM Transaction are “hard coded” as HTTPS calls.
- SAP First Guidance – SAP BW on HANA – Edition 2017
- SAP First Guidance – complete functional scope (CFS) for SAP BW 7.50
Note 2704178 – The error HTTP 500 “Redirect is not possible” occurs in /sap/public/myssocntl or in /sap/public/bc/icf/logoff
Note 2846151 – WEBGUI: “No OK code 200 in response from server.” when uploading large files
"SQL message: [IQ Error SQL-141:42S02][SAP][ODBC Driver][SAP IQ]Table 'TILM_STOR' not found". 597: Inconsistent configuration CX_XADK_DAS_SERVER DA Service Message: _DEFINE_ARCHIVE_STORES: Store S4H_400_ILM_IQ Does Not Correspond to ILM Conformance 2 598: Input or output error (triggered during access to file system, WebDAV, or data stream; see long text) CX_XADK_DAS_SERVER DA Service Message: _DEFINE_ARCHIVE_STORES: Store SAP_ILM_STORE Does Not Support the WebDAV Log
### used Services in the HTTP hierarchy - tx. SICF /sap/bc/webdynpro/sap/irm_policies /sap/bc/webdynpro/sap/ilm_audit_area /sap/bc/webdynpro/sap/das_store_browser /sap/bc/webdynpro/sap/ilm_store_admin /sap/bc/webdynpro/sap/wdr_test_input
Testing the ILM Functionality with IQ
for the testing of the ILM functionality, there are various Report’s available, which more less show a successful result or errors which are not related to the Solution. Additional checks can also be found in the Blog from Neenu Susan George – ILM Store Configuration and – ILM Store Troubleshooting
- RILM_STOR_TEST_HC_CLIENT (ILM Store: Health Check for Client Configuration)
- RILM_STOR_TEST_AT (Validation of BC-ILM 3.0)
- RILM_STOR_TEST_PF_SINGLE (only for file based archiving)
- RILM_STOR_TEST_CLEAR (needed to reset the Test Loop)
- RILM_STOR_WD_DEMO (test of the WebDAV Layer)
SAP ILM – 1st Step Done …
Ok., that was a Hell of a Ride
Nevertheless, this is another proved Example of SAP (Sybase) IQ Multi Purpose Database.
It is true: SAP (Sybase) IQ – the hidden treasure …
“I have no special talent, I am only passionately curious.”