Intelligent Invoice Scanning enhancements 2105
Intelligent Invoice Scanning enhancements 2105
In this blog post I will have a closer look at the new ‘Intelligent Invoice Scanning’ enhancements, introduced with release 2105. For an overview of the ‘Intelligent Invoice Scanning’ please also have a look at the following blog posts:
Already with release 2102 we have started to incorporate new features and round-offs for the intelligent invoice scanning solution, that was introduced with release 2008. You can find the details here:
Now, with release 2105 we continue this by adding a set of new capabilities:
- Automatic synchronization of supplier and company master data. Before release 2105 it was necessary to manually synchronize supplier master data in case of scanning-relevant changes. We now run a daily job that uploads the supplier and company master data to the Document Information Extraction Service. Once the ‘PDF-based Invoice Scanning’ feature is scoped, a background job will automatically be scheduled at 2.30 am. The customers do not need to take care of the scheduling of the job. Nevertheless, the synchronization of supplier and company master data can still be triggered manually in addition, if needed. The manual synchronization can be triggered in the work center Application and User Management – Master Data Synchronization. It might take up to 4 hours until updated master data are reflected in the scanning result.
- Collection of corrected scanned values for retraining. The PDF information extraction is based on a pre-trained model. Pre-trained means that SAP has used a set of invoices to train the model upfront. The key benefit of this approach is that there is no need for customers to first train the model upfront before reasonable scanning results are achieved. To further improve the quality of this global pre-trained model we now allow users to send corrected values back to SAP. To activate this the question ‘Do you want to train the ML model with the user values via feedback integration’ in Business Configuration needs to be answered:
Once this is set in scope, a new flag is available in the review UI to let the user confirm, that the review document does not contain any personal data.
This step is needed in order to stay compliant with the EU GDPR regulation, because we can only consider those invoices for retraining of the ML algorithm that don’t contain personal data.
Now, any corrected ‘Reviewed Value’ is sent to the Document Information Extraction Services.
Here we apply another check for personal data using an algorithm. In case any personal data are detected the document is immediately removed. Another post processing step is the UI annotation before the corrected document can be used for retraining. With the post-processing work by SAP, currently retraining of the model takes three or more months. In addition, if only a small set of invoices get corrected, the re-training effect might be small, because the model got trained with a huge number of invoices. We will investigate further in the upcoming releases, if this post processing duration can be reduced, e.g. by providing an annotation UI. Since SAP has already used a high number of invoices for retraining, an individual invoice correction might only have a very small impact on the model. Nevertheless, over time we expect an overall model improvement for all customers based on the re-training.
You can monitor the re-training progress with the newly introduced ‘Retraining Status’ value in the ‘Invoice Scanning’ work list.
- Creation of Credit Memos from scanned documents. Many customers requested to also allow creation of a credit memo from a scanned document. With 2105 we now introduced a radio button on the Review UI.
A user can now select to create a credit memo using the ‘Create Invoice’ action. A pop-up will allow users to optionally enter a supplier invoice ID, in case the credit memo references to a supplier invoice. Also, the purchase order ID will be used to identify if credit memo items can be mapped to a purchase order item. This will also be used to enhance the credit memo with additional information like the account assignment information.
Please also have a look at the video.
Thanks for the wonderful blog. Can you please clarify the following points:
thanks for your comment. I have updated the blog with the missing information. Please let me know in case you need more info.
Thanks for your blog post!
Are there any future plans to extract data from the Swiss QR Code (IBAN, etc.)?
Thank you and best regards,
With release 21/08 you can use intelligent scanning for Switzerland QR Bill.
You need to follow the steps described in the blog to enable the Intelligent Invoice Scanning in your system.
After that go in work center Supplier Invoicing, Invoice scanning and upload the pdf file containing the Swiss QR Bill invoice.
When the status is Scanning Completed, click Create invoice, click on the invoice ID link.
In New Scanned Invoice view, make sure a Supplier is selected if no one is selected automatically, Select a Payment Reference Type. Make sure a round trip is triggered after selection. Check the correctness of information detected and finish the creation of the invoice.
If you have further questions, do not hesitate to contact us,
Would there be any similar functionality in SAP Business One?
Hi Julio, if you ask about the Intelligent Invoice Scanning as an overall functionality we already released the integration of the AI Business Service - Document Information Extraction with Business One on 21.05 delivery. However as Business One is a OnPrem license and this is a Cloud Service we only provide the integration and the customer need to acquire the service from SAP Store: https://www.sapstore.com/solutions/44901/Document-Information-Extraction
Thank you in advance for the response.
Regarding the ROAD MAP, could this function be available for future versions of SAP B1 (OnPrem)?
It is already available. The first release was in February and then the enhanced feature came with May release. Just take a look on SAP Help.
Nice blog post and a very comfortable function.
Where can you trigger manually the synchronization of supplier and company master data?
Thank you and regards,
thanks a lot for your feedback. The master data synchronization was moved and is now available in work center Application and User Management - Master Data Synchronization.