Processing Types

Data process type are divided into the categories 'Bulk Transfer and Batch Compare', processes for processing archived database logs ('Archived Logs'), and processes for real-time processing of changes that occur ('Active Logs/Realtime CDC'). Under 'Other processes' processes are listed that basically correspond to one of the three main categories, but do not perform the complete input-processing-output.

Features of bulk transfer processes:

  • Efficient transfer of entire databases and files
  • For all databases, backups/extracts/unloads of databases, and sequential files
  • Analysis for data consistency
  • Ideal as ‘initial load’
  • Suitable for periodic mass data transfer
  • data exchange in one step (extract, transform, apply)

Features of batch compare processes:

  • Comparison of data snapshots
  • Efficient transfer of change data since the last run
  • For all databases with direct access and sequential files (sorted by key)
  • Automatic creation of deltas by RDRS
  • Safe restart after error incidents

Features of processing archived logs:

  • Processing of DBMS log files
  • For all data sources providing archive logs
  • Transfer of the change data within predefined time intervals
  • Ideal as nightly batch processing
  • Suitable as processing right after log commit

Features of real-time processes:

  • Near real-time capture of change data
  • Obtains the change data information directly from the DBMS or active log
  • For all data sources providing active logs
  • Secure data management, even across a DBMS restart

So-called 'control processes' are a special form. They do not primarily process data, but can monitor and control other processes.