AboutYourData on Google PlusAboutYourData on linked in

Data Migration

Data Migration is the process of extracting data from one system and loading it into another system. These systems may run on different hardware platforms, run different software packages and use different databases. The details of hardware, software and database make no difference to our data migration tools.

Often, the installation of a new computer system is an opportunity to fix all the data issues that have crept into your existing computer systems but have been either too hard or too complicated to fix. When migrating your business data from one system to another, your company has to transform the data they have so that it will work within the system they want to install. There are a number of components to this process.

Exporting Extracting the data from the existing system. The format of the data is not an issue, so long as it is available electronically.
Cleansing Presenting data in a consistent format from record to record. Elements such as Salutation, First Name, Last Name, Email addresses, Residential or Postal addresses are examples.
Correction Changing the data from one incorrect value to another by way of rules that allow this change to be recognised and made.
Reporting Identifying data which is incorrect so that it can be fixed in the existing system.
Selection Selecting the data that is to be brought over to the new system.
Consolidation In some instances there may be duplicate data from multiple sources. This data needs to be consolidated to remove duplicates.
Transformation Changing the format of the data to that of the new computer system.
Importing Bringing the data into the new computer system

Some of these processes can occur at the same time others may not be required at all.

AboutYourData Migration Tool

How do you get the data from one place to another ? Data can be migrated to your new computer system using two methods: Manual data entry or importing data files into the new data base.

Manual data entry via the user interface of the new system requires a person to key data into the new system in much the same way as they would when using the new system. This hides the complexity and associations of the underlying database files.

Importing the files into the database is much faster but requires an understanding of how the files in the database relate to each other. It also means that there must be a process to convert the data from its original format into a format that matches the database of the new system. This can be done using tools such as Access, Excel or SQL. Normally, the files are imported as CSV files.

Migration Factors

FactorManual Data EntryManual migration - Data ImportAutomated migration Tool – Data Import
Auditability. The need to review how a new piece of data come to be present No No Yes
Speed. How long does it take to get the new data into the new system Weeks Days Minutes
Repeatability. Can I migrate the data multiple times? No No Yes
Consistency. Is there any guarantee of consistency each time I migrate the data No No Yes
Data Integrity. How do I manage the data integrity between old and new computer systems ? Manually Manually if the data set is large as migration may stil take a while Not required. The data is converted from the old system to the new in 2 – 3 hours depending on the data set size.
Complexity. Can I make complex changes to data as it is migrated No Limited Yes
Flexibility. Can I change the way data is migrated if my requirements change? No, you may have to start again. No, you may have to start again Yes. Just change the rules and rerun the migration