SmallNet ETL Framework
SmallNet has produced its own ETL (Extract Transform Load) framework for the development and deployment of data warehousing and data integration projects.
The SmallNet framework includes:
- Development and design standards and best practice.
- Project plan templates.
- A deployment architecture comprising:
- Scheduling and control layer.
- Runs and logs all jobs in the application, tracking their progress.
- Error and event handling layer.
- Manages the logging of all errors raised.
- Audit and reconciliation elements.
- Manage the capture of the data processed through the framework.
- Job structure:
- Extract – the extraction of data from the source to the DataStage environment. Once extracted the data is validated for completeness and cleansed (and, if necessary, standardised) to ensure quality.
- Transform – cleansed and validated data is mapped and enhanced.
- Load – loads data into a specific target file. This process
- Pre-built components that save you time and money.