Processing Types
Data process type are divided into the categories 'Bulk Transfer and Batch Compare', processes for processing archived database logs ('Archived Logs'), and processes for real-time processing of changes that occur ('Active Logs/Realtime CDC'). Under 'Other processes' processes are listed that basically correspond to one of the three main categories, but do not perform the complete input-processing-output.
Features of bulk transfer processes:
- Efficient transfer of entire databases and files
- For all databases, backups/extracts/unloads of databases, and sequential files
- Analysis for data consistency
- Ideal as ‘initial load’
- Suitable for periodic mass data transfer
- data exchange in one step (extract, transform, apply)
Features of batch compare processes:
- Comparison of data snapshots
- Efficient transfer of change data since the last run
- For all databases with direct access and sequential files (sorted by key)
- Automatic creation of deltas by RDRS
- Safe restart after error incidents
Features of processing archived logs:
- Processing of DBMS log files
- For all data sources providing archive logs
- Transfer of the change data within predefined time intervals
- Ideal as nightly batch processing
- Suitable as processing right after log commit
Features of real-time processes:
- Near real-time capture of change data
- Obtains the change data information directly from the DBMS or active log
- For all data sources providing active logs
- Secure data management, even across a DBMS restart
So-called 'control processes' are a special form. They do not primarily process data, but can monitor and control other processes.