Data from the source database may include inaccurate or unusable values you don't want to add to the target database in their current form. AVR Connection Center gives several opportunities to perform the most important operations of correcting unsatisfactory data during transfer.

 

 

 

Time jitter correction fixes inaccurate dates by setting the value of seconds to 0 in every row. Enabling this requires selecting the field containing timestamps.

 

After enabling any of the other five features we are expected to specify the numeric column containing values (usually values measured by instruments). All of these options will work on the contents of this field.

 

Null value correction is activated if a row of the source table contains an empty (Null) value. It can perform one of the following steps: it either discards the row or replaces the value with a default one. In the latter case the empty value will be overwritten with the number we specify.

 

Zero value correction allows replacing zero (0) values with a value of your choice.

 

Negative value correction is used to replace values less than zero.

 

You can set a Minimum threshold to replace every value below this limit with one supplied beforehand.

E.g. if you set Minimum value to 10 and Replace values below threshold with to -1 then every value below 10 will be changed to -1.

 

Maximum threshold works the same way except that it can be used to modify values which are greater than the limit.

 

Messages produced during these operations (e.g. data conversion errors caused by selecting columns of an unsuitable data type) are not logged by default - this has to be enabled using checkbox Log data quality operations on demand. Such errors do not stop the execution of the configuration either (even if Stop data transfer on error is enabled on page Performance) but this can also be requested by checking Stop data transfer on data quality error.

 

The order in which these steps are executed may be determine for the results if we have enabled more than one of them. This can be adjusted to our needs using the up/down buttons on the right side of the list. Data quality operations will be performed in the order of their positions in the list.

 

Data quality procedures are executed during the step of data transfer, right before VB code on source data (4).