Data Integration (DI) is the automated consolidation or sharing of data across an organisation. More generally DI helps to create unified data repositories from disparate sources to facilitate cross function functional reporting and analytics. It is also to automate the sharing of critical and common business information between systems that require shared and consistent data, such customer details. Traditionally undertaken as batch processing periodically, in more recent times there is demand for real time integration to support business agility and performance.
DI is a key component of the digital transformation initiative.
Data integration has been around for many, many years and has been evolving with the technology advancement but at its HEART it is a strategy being the first steps in transforming data into both meaningful and valuable information.
Integrating data from disparate sources is not always easy can have many challenges, starting with initial data acquisition from the source, transforming / normalising data so that is can be reliably consumed, combined and compared, addressing data quality issues and ensuring the data is available in timely manner. Over the years tools and techniques have evolved to address these challenges as has our experience and IP.
We at SmallNet consulting have been involved since the start of modern Data Integration and all of its variants and iterations for over 20 years with hands on practical experience, starting in the days of scripts and coding through to modern ETL, real time messaging technologies and data virtualisation. Over the years we have built a wealth of experience and IP across the board to help you build both simple and complex integration solutions. If you need any advice or guidance in any scenario then give us a call, not matter the size or complexity we have seen them all.
Success stories
Reinsurer Creates a Trusted Data Source with Data Cataloging and Data Lineage
A Smallnet client who is a leading Insurer and... read more
A Leading Property & Casualty Insurer & Re-insurer Netezza Data Warehouse Migration
For the past 7 years or more IBM have... read more
Data governance and Catalog Use case
SmallNet currently support a leading insurer operating in the Lloyd's,... read more
Here are some examples of Data Integration solutions we created:
- Data acquisition and unification for analytics and business intelligence (BI), Data Lake and Data Warehouses
- Integrating Cloud based applications
- Support for Data governance and management of data assets
- Sourcing and delivery of master data in support of master data management (MDM) or Operational Data Stores (ODS)
- Data consistency between operational (business) applications
- Inter-enterprise data sharing