- \n
- Paribus 365™<\/li>\n
- Microsoft Dynamics 365 CRM<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
<\/p>\n
<\/h2>\n
Purpose<\/u><\/strong><\/p>\n
The purpose of this document is to provide partner guidance on how to run Paribus 365™ audit\u00a0 on their customers\u2019 Dynamics 365 CRM system for data duplication.<\/p>\n
Paribus 365™ Data Cleansing \u2013 The Identification & Review Process<\/u><\/strong><\/p>\n
Let\u2019s first give you an understanding of how the system architecture manages this.\u00a0 In the data deduplication process, there are essentially two stages.<\/p>\n
The first is to identify where you may have duplicate records in your system and once you have selected which records you want to merge, you then would then initiate the second stage of merging those records. Fig 1 illustrates how that review process is managed.<\/p>\n
![\"The](\"https:\/\/www.paribuscloud.com\/help\/wp-content\/uploads\/2018\/03\/HowTo_D365_1.png\")
<\/p>\nFig 1 \u2013\u00a0The identification process<\/p>\n
After installing the Paribus 365 Data Cleansing™ Client Software on your PC we have to establish the Source of the data for the merge.<\/p>\n
A data extraction utility is used to extract Account, Contacts & Leads data from your online or on-premise CRM, in to a Source Extract Database.<\/p>\n
To enable the data matching review to be conducted a Control Database is created. This Control Database houses the output of the matching process, the Match Sets & Conditions (which can be modified) and the Match Sessions, which define which fields you are matching on and to what sensitivity.<\/p>\n
Once the data within the Match Session has been reviewed it is time to run the Merge process. As outlined in Fig 2, this is enabled through running a plug-in for the respective CRM system in Paribus Discovery.<\/p>\n
This plug-in connects enables the Control Database to update the Live Source Database with the changes selected, through a Direct Connection via the API.<\/p>\n
![\"\"](\"https:\/\/www.paribuscloud.com\/help\/wp-content\/uploads\/2018\/03\/HowTo_D365_2.png\")
<\/p>\nFig 2 \u2013 System Architecture for the Record Merge<\/p>\n
Paribus 365 Data Cleansing™ Duplication Exercise \u2013 Stage 1<\/u><\/strong><\/p>\n
Request a Paribus 365 free trial.<\/a><\/p>\n
We will then be in touch asking you to confirm the details of the Customer, so that we can setup a Subscription relating to the trial license.\u00a0 Once the Subscription has been set-up you will be sent a license key, & using the installation instructions in the automated e-mail you will have been set you can install the software.<\/p>\n
Paribus 365 Data Cleansing™ Duplication Exercise \u2013 Stage 2<\/u><\/strong><\/p>\n
The next stage of the Duplication process is to use the Data Extraction Tool (Fig 3). This file is stored under the Data Extraction Utility folder of the software you have installed.<\/p>\n
![\"\"](\"https:\/\/www.paribuscloud.com\/help\/wp-content\/uploads\/2018\/03\/HowTo_D365_3.png\")
<\/p>\nFig 3 \u2013 Data Extraction \u2013 Microsoft Dynamics 365 CRM Only<\/p>\n
Advice on defining the service connection to enable this data extract can be found here<\/a>.<\/p>\n
Paribus 365 Data Cleansing™ Duplication Exercise \u2013 Stage 3<\/u><\/strong><\/p>\n
The next stage in the process is to recreate a Control Database (Fig 4). See page 25 of the installation instructions<\/a>\u00a0to learn\u00a0how to do this.<\/p>\n
![\"\"](\"https:\/\/www.paribuscloud.com\/help\/wp-content\/uploads\/2018\/03\/HowTo_D365_4-1.png\")
<\/p>\nFig 4 \u2013 Create Control Database<\/p>\n
During the process of setting up the Control Database it will need to be pointed to the Source Database\/Source Extract Database (See Fig 5).<\/p>\n
![\"Paribus](\"https:\/\/www.paribuscloud.com\/help\/wp-content\/uploads\/2018\/03\/HowTo_D365_5.png\")
<\/p>\nFig 5 \u2013 Point Control Database to Source Database \/ Source Extract<\/p>\n
Paribus 365 Data Cleansing™ Duplication Exercise \u2013 Stage 4<\/u><\/strong><\/p>\n
The next stage is to import the Match Definitions (Fig 6). You will need to import the Definitions appropriate for your CRM. \u00a0See page 29 of the installation instructions<\/a> on how to do this.<\/p>\n
![\"\"](\"https:\/\/www.paribuscloud.com\/help\/wp-content\/uploads\/2018\/03\/HowTo_D365_6.png\")
<\/p>\nFig 6 \u2013 Import Match Definitions<\/p>\n
Please note:<\/strong> For this exercise, it is important to use the Standard Paribus 365 Audit<\/strong> Definitions that have been supplied (Sessions 1,2,3 & 11) and run the reviews against the criteria already set (see below).<\/p>\n
Session 01 – PARIBUS AUDIT: Account Name 95%, Address Composite 95% – No Filter<\/p>\n
Session 02 – PARIBUS AUDIT: Account Name 90%, Address Composite 85% – No Filter<\/p>\n
Session 03 – PARIBUS AUDIT: Account Name 80%, Address Composite 85% – No Filter<\/p>\n
Session 11 – PARIBUS AUDIT: Contact Name 90%, Account Name 95%, Address Composite 95% – No Filter<\/p>\n
Session 12 – PARIBUS PRODUCTION: Contact Name 90%, Account ID = – No Filter<\/p>\n
This enables a direct comparison with the results from our study. A customer can clearly see where they compare with the average levels of Duplication, and can benchmark against the best that can be achieved.<\/p>\n
In a real scenario the Accounts would be merged first, followed by the Contacts and also the criteria used would need to reflect how the Account hierarchy has been structured.<\/p>\n
Paribus 365 Data Cleansing™ Duplication Exercise \u2013 Stage 5<\/u><\/strong><\/p>\n
The next step is to run the match sessions (Fig 7).\u00a0 \u00a0See page 36<\/strong> of the installation instructions<\/a> on how to do this:<\/p>\n
![\"\"](\"https:\/\/www.paribuscloud.com\/help\/wp-content\/uploads\/2018\/03\/HowTo_D365_7.png\")
<\/p>\nFig 7 \u2013 Running Match Session<\/p>\n
Then record the results of the four match sessions in the spreadsheet supplied, update the charts, and the customer output template (Fig 8 and Fig 9).<\/p>\n
![\"\"](\"https:\/\/www.paribuscloud.com\/help\/wp-content\/uploads\/2018\/03\/HowTo_D365_8.png\")
<\/p>\nFig 8 \u2013 Recording Match Session Results<\/p>\n
![\"\"](\"https:\/\/www.paribuscloud.com\/help\/wp-content\/uploads\/2018\/03\/HowTo_D365_9.png\")
<\/p>\nFig 9 \u2013 Updating Charts<\/p>\n
Paribus 365 Data Cleansing™ Duplication Exercise \u2013 Study Results<\/u><\/strong><\/p>\n
As a result of our study, it was established that with the use of Paribus 365 Data Cleansing™, it is possible to reduce duplication percentages to 1\/20thth <\/sup>of average duplication levels experienced.<\/p>\n
Average duplication levels are circa 4%. This is compared with levels of 0.2% that are achievable through the use of Paribus 365 Data Cleansing™.<\/p>\n
The conclusions of the study also suggest that there is not necessarily a direct correlation between the age & size of the database and the duplication percentage. But, there does appear to be link between the company market type and the duplication percentage.\u00a0 With those dealing in Business-to-Consumer markets generally having a higher duplication percentage than those dealing on a Business-to-Business basis.<\/p>\n
Paribus 365 Data Cleansing™ Duplication Exercise \u2013 Study Implications<\/u><\/strong><\/p>\n
The implications of this study suggest that the use of Paribus 365 Data Cleansing™ can considerably reduce the amount of duplicate records in a CRM system. And whilst \u2018on the face of it\u2019 a duplication percentage of 4% might be deemed acceptable, 4% of say 15,000 records, would mean that potentially there may be 600 records in your system where you have duplication.<\/p>\n
With duplicate records in your system there is the potential for misaligning Service & Sales data against the wrong record, double counting Sales Opportunities in your pipeline, sending information to the wrong e-mail address, sending Marketing material to the same person multiple times or indeed sending irrelevant Marketing material to those customers of yours whom may already have the products or services you are trying to promote.<\/p>\n
This may or not be deemed an acceptable business risk, but a company has the chance to establish what level of duplication they have in their system & assess that risk.<\/p>\n
Against the backdrop of GDPR, there are also considerations about what exposures you may have as a result of having duplicate records in your system.<\/p>\n
Whilst there are a number of factors involved in GDPR compliance, you may find it useful to understand what role Paribus Discovery can make in the identification of data held & its\u2019 influence on meeting the requirement of the \u2018Right to be Forgotten\u2019\u00a0this blog<\/a>\u00a0refers to.<\/p>\n