Validation data flow

The Validation process does not create a new version of the data unless the validation is triggered by the editing process or manual validation. Rather, the reading validation process assigns a validation status of Pass, Warn, or Fail to the data and then saves it to the database or creates a queue item, whichever is appropriate. For more information, see Validation statuses.

  1. A cut of data enters IEE. Typically, for AMI readings import or standard readings import operating in DCW mode, this cut represents 24 hours of interval and register reads. For standard readings import operating in other modes, the time period of the cut varies.

  2. IEE runs the validation sets attached to that service point channel. For AMI readings import and standard readings import in DCW mode, IEE runs the validation set associated with validation slot 1. For other import modes, IEE runs the validation sets in order: validation slot 1, validation slot 2, and then validation slot 3. The validation rules run in the order defined in the validation set.

  3. IEE records validation statuses at the rule level and the slot level.

    • Validation rule. IEE records a validation status for each validation rule. For example, an interval that fails a spike check rule is marked with a status of SPIKE.

    • Validation slot. The worst validation status of all rules in the validation set determines the final validation status for that set. For example, if most of the rules pass, two of the rules warn, and one rule fails, the final validation status for the entire validation slot is FAIL. The reading can have a maximum of three validation statuses, one for each validation set.

  4. If the data fails validation and auto-estimate is enabled, IEE runs the estimation routines included in the estimation set associated with the service point channel. Estimation routines run in the order defined in the estimation set. If auto-estimate is disabled, no estimation takes place. IEE creates items in the validation queue and validation log, depending on the validation status and the Route to Queue (Do Not Auto-Estimate) parameter for each rule.

  5. IEE runs any estimated data through secondary validation. This final validation test determines the final validation status of the data. If data fails secondary validation, IEE creates items in the validation queue and the validation log and does not create any new readings. If data passes secondary validation, IEE creates items in the validation log and the estimated readings are saved.

  6. IEE saves the validated data to the database. If data was estimated and passed secondary validation, IEE saves the original raw reading as well as the estimated final reading. The estimated reading is considered the current version of data.

  7. Queue operators and administrators use the reading validation queue to investigate and resolve invalid data. For more information, see Validation queue.