SAP ERP to SuccessFactors Employee Central data migration RDS
*UPDATE July 19th 2018: SAP have retired this package*
On the many Employee Central implementations that I have worked on, data migration has always been a huge undertaking for customers and for the implementation team. Extracting large volumes of data from any system – SAP ERP HCM or otherwise – and transforming that data from the source format into the format required by Employee Central is a mammoth activity, whether you have a few hundred employees or tens of thousands. I always like to be totally transparent with customers and warn them before a project kicks off to the magnitude of the effort required. This is why I was delighted to hear about the release of the Rapid-Deployment Solution (RDS) for migrating SAP ERP HCM data to SuccessFactors Employee Central some months ago. In this blog I will give the lowdown on the RDS package and discuss how this solution can help you migrate your SAP ERP HCM data to Employee Central.
The RDS provides a full solution to analyze, extract, clean, transform and validate data from SAP ERP HCM and then load and reconcile that data directly into Employee Central. The RDS runs on SAP Data Services and the out-of-the-box solution comes with full mappings between SAP ERP HCM infotypes and Employee Central HRIS elements and fields (which can be modified as required by the customer and means that custom fields on both sides can be mapped), project methodology, Business Process Documents, and test plans per object. The RDS is available at no cost to SAP customers, although customers who do not use SAP Data Services would need to license SAP Data Services.
The solution is built on SAP Data Services, which is the same solution used to replicate data from SuccessFactors HCM suite to SAP Business Warehouse (BW). Without wanting to cover the core capabilities of SAP Data Services too much, it is important to point out that the solution provides a number of Extract, Transfer, and Load (ETL) functions:
- Importation of metadata from the target system
- Data field mappings between systems
- Validations (e.g. address validations)
- Source from multiple systems (e.g. SAP ERP, database, legacy system, etc.) and file types (e.g. CSV, TXT, XML etc.)
Because this solution is built on SAP Data Services, it does not even require SAP ERP to be the data source. In fact, the solution supports multiple different data sources and so data can come from any and multiple databases, SAP systems, non-SAP systems, or flat-files (e.g.CSV, XML, etc.). Below is a screenshot of SAP Data Services:
For more information on SAP Data Services, I highly recommend checking out the SAP Help page for SAP Data Services or the SCN document SAP Data Services Product Tutorials by Ina Felsheim.
How it works
The RDS is designed with a six-step process flow, as illustrated in the diagram below:
The below diagram illustrates the process architecture for each of these six steps:
Now let’s discuss each of these steps in a little more detail.
In this step of the process the source and target systems are analyzed and the SAP Data Services environment is prepared. During this analysis step, the data can be profiled on the source side to learn more about the source structure and understand the legacy data model. For example, the patterns of the postal codes are analyzed and different unique values for states and country are identified. This will help with both the field and value mapping.
In this step the data is extracted from the source system (e.g. SAP ERP HCM) into the SAP Data Services staging area where it is profiled and is prepared for the next step. Here the data can be analyzed and dissected to ensure consistency. Examples stated by Frank Densborn in his blog A better way to migrate your SAP data with Rapid Deployment Solutions might be checking the US 5-digit zip code (and optional 4-digit ZIP+4) or Germany being referred to as Germany, DE, or Deutschland.
In this step the extracted data is cleaned, parsed, and transformed. This means ensuring that things like names, addresses, cost centers, etc. are in the correct format, that target data types are matched, and that data integrity is validated. It also means ensuring that the data meets specific formats, patterns, and is reformatting as necessary (e.g. concatenating fields, or breaking them into two or more fields as required). Additionally, here you have the opportunity to do a “search and replace” on certain values to update them as necessary. Overall, this step gives you the opportunity to review and correct data and ensure that any data is accurate.
In this step (not shown in 6-step diagram, but shown in the architecture diagram) the clean data is transformed into the target Employee Central format using the mappings. Prior to the transformation, if necessary, the delivered mappings can be modified based on customer-specific requirements. The screenshot below shows a mapping process flow in SAP Data Services:
Below we can see a mapping process definition for SAP infotype 0006 to Employee Central HRIS element homeAddress:
And finally we can see a mapping between field ORT01 and field city:
In this step the Employee Central metadata (object structures, HRIS elements configuration, countries, languages, lookup values etc. for validations) is extracted into SAP Data Services and the transformed data is validated using business rules defined by the metadata. This ensures the data will match the target Employee Central system.
Once the data is validated and ready then the load process can commence. The majority of the data – all but some of the Time Off data – is loaded into Employee Central using the OData API. However, it is possible to output the data as CSV files to upload manually. This is lift off!
Once the data is loaded then the reconciliation can take place. This is essentially a comparison of what was actually loaded against what you expected to be loaded. This is done via dashboards and WebI (Web Intelligence) reports in SAP BusinessObjects BI Platform.
What’s in scope?
There is a fairly comprehensive scope for the RDS, which includes all data required. The only exception are workflow objects, which are not replicated as part of the RDS. The following list indicates all items that are in the scope of the RDS:
- Foundation Objects:
- Legal Entity
- Legal Entity Local
- Business Unit
- Location Group
- Cost Center
- Job Classification
- Job Class Local
- Job Function
- Pay Component
- Pay Component Group
- Pay Grade
- Pay Group
- Pay Range
- Event Reason
- Dynamic Role
- Position data
- Employee Data:
- Profiles and User accounts
- Biographical information
- Personal information
- Personal Global Information
- Direct Deposit information
- Email information
- Emergency Contact Information
- Address Information
- Phone information
- Social Account information
- National ID Information
- Employment information
- Job Information
- Job Relationships
- Compensation Information
- Recurring and Non-Recurring Pay Components
- Termination Information
- Time Off data:
- Employee Time
- Employee Time Calendar
- Time Account
- Time Account Change Calendar
- Time Account Detail
- Time Account Eligibility Status
- Time Account Type
- Time Account Type Rule Group
- Time And Labor Configuration
- Time Type
- Time Type Profile
In addition to Employee Central, there is also predefined scope for migrating data to Employee Central Payroll. The following infotypes are in scope:
- Residence Tax Area (IT0207)
- Work Tax Area (IT0208)
- Unemployment State (IT0209)
- Withholding Information W4/W5 US (IT0210)
- Additional Withholding Information (IT0234)
- Other Taxes US (IT0235)
- Payroll Results (T558B)
- Payroll Results (T558C)
- Payroll Results (T5U8C)
- Garnishment Document (IT0194)
- Garnishment Order (IT0195)
- Contract Elements (IT0016)
- Loans (IT0045)
- Loan Repayments (IT0078)
SAP customers can download the RDS at no cost and can get the RDS up-and-running in SAP Data Services in less than one day. If you don’t use SAP Data Services then you may need to set aside approximately 2 to 3 days to install and test SAP Data Services in a server environment. A partner is not required to implement the RDS if you have SAP Data Services skills in-house. Deployment information and prerequisites for SAP Data Services can be found in the Master Guide on SAP Help page for SAP Data Services.
The only prerequisite of the solution is SAP Data Services version 4.2. Please note that documentation is only provided in English at this stage.
You can view details and scope of the package on SAP Service Marketplace using this link (expand Data Migration to SuccessFactors Employee Central) and download the package from the Software Download Center (SWDC) using this link.
More Information & Additional Resources
There are a number of resources you can view to get more information:
- The solution scope of SAP Service Marketplace
- A YouTube video demo of the solution
- A presentation of about the RDS on Brainshark
- Data Migration space on SCN
- The SAP Press title Integrating SuccessFactors with SAP includes a chapter on data migration
- SAP Help page for SAP Data Services
Questions on data migration – including this RDS – can be raised on the Data Migration space on SCN.
The value of this RDS cannot be argued; it removes the huge headache of extracting, transforming, and uploading data into Employee Central from a number of data sources, including SAP ERP HCM. Additionally, the RDS mitigates the risk with this process and helps you get your system live with trusted data. The package is available at no cost to SAP customers, although it does require the SAP Data Services solution that you might not be using right now. This RDS will drastically reduce the time and effort needed to get your data from SAP ERP HCM to Employee Central and ensures that you can avoid a Garbage In, Garbage Out (GIGO) scenario once you go live with your new Employee Central system.
Really great job with this Luke.
The grey area for me is the "SAP Data Services" which I am not familiar with. Hopefully SAP/SF or the community can provide some additional clarity as to if your "average" SAP HCM would already have this in place as if so great but if not than all the good functionality above suddenly becomes not all the easy to use as deployment and licensing comes into play to get the underlying technology needed.
Thanks Jarret. I wouldn't know how many customers have SAP Data Services, but it completely makes sense to use this solution given its ETL capabilities. As you can see in the blog, it only takes a day or so to get it up-and-running (in fact, SAP Professional Services can get it up-and-running in under 1 day) - but there are of course licensing implications. However, given the headache that data migration brings it would most likely be a worthwhile investment.
This is a great piece of info Luke !
so this would also work like dell boomi which is on cloud ? are there any advantages of going with it besides using Boomi ? Boomi also come free with EC as far as I know & also has got certain standard interfaces built.
BOOMI doesnt come free, its included in the licenses. Also, what is your scenario? BOOMI delivers standard iflow integration
Siddharth is correct about Boomi.
Boom is an integration middleware and not a data migration solution, so the use case is different.
thanks for into Luke. is there a way in RDS to map the fields between source system/ EC and schedule a job that can run on weekly basis instead of one time data migration?
Pre-delivered mappings are provided, but they can be changed so you can use your own mappings.
As far as I know the tool is not meant to be used as an integration middleware, rather a one-time data migration solution. However, Frank Densborn should be able to confirm if the use case is at all possible.
Faisal, you could certainly do that. All the data migration objects are coming with data flows in Data Services jobs that could either run manually or scheduled in data services. You could even add filtering logic. But the intention of a full legacy migration is to switch off the source system at one point in time. But it's possible and would include all the data quality options that the tool provides.
Thanks Luke for sharing so useful information. I am assuming that we can also add business logic to extract the data based on certain conditions. For example some customer would like to migrate only the first record and latest record to new system.
Yes, you can use a variety of conditions and mappings etc.
As usual great blog...Thanks for the information. Correct me Luke if I am wrong SAP Data Service is sold as part of BI/BW Components so what if a customer doesn't have SAP currently (not even a single module) and wants to use this Data Service to transfer data to SF-EC...is that possible and interested to know the pricing involved in it as well
SAP Data Services, formerly known as BusinessObjects Data Integrator, does have a separate license that is not necessarily bundled with BusinessObjects BI Platform. It is not necessary to own other SAP licenses and it could certainly be used standalone for this task. If you want to take advantage of the WebIntelligence reports, the BI Platform is needed in addition. There are several options and different flavors as you might know, so it would be best to send me a personal note that we can discuss further.
Here's the latest info in regards to the rapid data migration to Cloud Solutions from SAP (data migration to SuccessFactors).
Thanks Michael! Great updates to the RDS 🙂
It is wonderful write up. but need to know other possible option to integrate SF with ERP/ Third party system.
For data migration from SAP ERP HCM to EC you can use Infoporter
Do any of you have some clients we can talk to about utilizing RDS DS for this data conversion, integration, validation between SAP S4 HANA 1610 and SuccessFactors. We are leaning towards the RDS DS solution but would really like to speak to some companies who have done it already. Thanks for any help! I can be reached directly at firstname.lastname@example.org or 910-228-1697
Most of my clients have used Infoporter
Hi Luke, how do you connect to ECC? Rfc or a direct connection in the designer?
It uses application-level communication via the designer.
I am searching for SAP RDS Data services ATL’s and predefined mapping templates in SAP Service Marketplace for Success factors data migration. But I am unable to find it in SAP Market place, kindly can you provide us any link for downloading the Dataservices contents as part of SAP RDS.
I am searching for SAP RDS Data services ATL's and predefined mapping templates in SAP Service Marketplace for Success factors data migration. But I am unable to find it in SAP Market place, kindly can you provide us any link for downloading the Dataservices contents as part of SAP RDS.
Try this link:
The link is not working. Is Data Migration using DS to SucessFactors supported ? Please guide me to the appropriate link.
It works for me Raj. Are you logging in with an S-User? What error do you get?
Yes, I am using S-User, but still no luck..
I am able to open the link, but it says Retired . What does this mean? no more data migration with DS to SF not supported ?
I have confirmed with SAP Product Management that the solution has been retired
Very Informative & Wonderful blog Luke.
Thanks for informative blog
My customer has non-Unicode SAP HR system on premise. Is it required to convert the system to Unicode before migration to SuccessFactors?
Is this solution still available?
Thank you in advance
Thanks for your comments.
It's not necessary to have your system as Unicode, although it is SAP's best practice that SAP systems are Unicode.
From what I have gathered so far there are a few approaches to consider for Data Migration from SAP HCM to Employee Central :
So the suggested option to recommend is 1 .
What is your take on it ? Will await your reply.
Option 1 is really the only option available. There is no point on pursuing option 3 when option 1 is available. There might be some instances where you need to build your own export programs, but going down the manual route will be significantly more challenging than using infoporter.
Hi Luke Marson Frank Densborn ,
For one of our client, we are in a plan to migrate the data from various sources to Successfactors Employee Central(EC) via Data Services. As I can see here, RDS for DS to SF has been expired and we are planning to create the objects from scratch to achieve this. We have few queries in establishing the connection between Data services and SF EC.
Thanks & Regards,