Configuring or editing the validation and estimation settings

Use the following procedure to configure or edit validation and estimation system settings:

  1. Go to System Administration > Sys Admin > System Settings.

  2. From the Section dropdown menu, select Validation and Estimation.

  3. Configure the following parameters:

  • Editing

    Determines whether IEE allows editing and deleting of register reads for register channels that are linked to interval channels.

    • Select True to allow register reads to be edited or deleted even when they are linked to an interval channel.

    • Select False to prevent register reads from being edited if they are linked to an interval channel.

    Defines the maximum number of audit entries to display in the Edit Log user interface without returning a warning. Enter a whole number. When using a broad query that does not include a specific service point and service point channel IEE can return a large number of results. Use this value to limit the number.

    Determines the behavior of edited intervals. When set to True, edited intervals retain all Statuses to Mark and the estimated statuses are removed (except for INSTALLEDDEMOLISHED, METERCHANGE, SWITCHEDOFF and Type 58, which are retained). When set to False (default), the existing behavior is performed. The Statuses to Mark, and the estimated statuses (added by the estimation process), are removed from the edited intervals.

  • Estimation

    Click the ... button at the end of the field. The status selector displays the interval statuses available in IEE, which can be selected similar to selecting statuses in estimation routines.

    When performing a meter swap for different interval lengths, or when the new meter doesn’t have any historical data, the old meter data will be rolled to the new meter's interval length to perform estimation, and the estimated reads will be marked with alternate statuses as per the setting for that period.

    If the new meter has historical data, or meters are of the same interval length, then these alternate statuses are ignored.

    This setting is applicable to Two week like-day historical estimation and Multi-week average estimation.

    Determines the number of channels processed by each thread managed by the Bulk Estimation Service. The Bulk Estimation Service’s task template (Additional Setup) is configured to Run DCW Mode Processor. See Validation and Estimation Threads Count Settings and Chunk Size Settings for suggestions related to fine-tuning this setting.

    Determines the number of threads to use for parallel processing when the bulk estimation service runs once per day after the data collection window closes.

    Determines how many times each day the Bulk Estimation Service processes pending estimation items. Set to 0 to perform bulk estimation immediately as data arrives.

    Determines whether a new read that comes in (for example, through reading import, estimation process, or editing) honors the FINALESTIMATE reading status. If set to True, a new read with any other status (actual, estimated, edited, PV, FV, or other) will not overwrite a read with a FINALESTIMATE status. Also, when set to True, readings with a FINALESTIMATE status can only be overwritten by another reading with a FINALESTIMATE status.

    In some of the markets using IEE, there is a concept of a Final Estimation. In these cases, the interval is marked as final, and no further modification is allowed. This parameter allows the user to indicate that the FINALESTIMATE status should be used to block modification of the interval by any new read.

    For more information, see UsageDiffOnFinalEstimateCheck in Interval validation rules.

    Determines whether IEE logs unscaled estimates after estimation. Select True to enable this setting. When True, unscaled readings are logged in the EstimationToDo database table while saving the readings. If False, nothing is logged in the EstimationToDo database table.

    When enabled, you must configure the following related parameters:

    • Unscaled Estimates Boundary in Days

    • Unscaled Estimates Detection Window in Day

    • Unscaled Estimates Detection Window End Day

    • Scaling Estimation Processor Chunk Size

    • Scaling Estimation Processor Threads Count

    • Bulk Action Latency (Seconds)

    • Run Bulk Estimation within ARI DCW

    Determines the number of channels processed by each thread managed by the Manual Estimation Processor. Enable the Manual Estimation Processor by clicking Run Manual Estimation Processor on the Bulk Estimation Service’s task template (Additional Setup). See Validation and Estimation Threads Count Settings and Chunk Size Settings for suggestions related to fine-tuning this setting.

    Determines the number of threads the bulk estimation service uses for parallel processing of bulk estimation requests that are created from the validation queue.

    Determines the number of channels processed by each thread managed by the Periodic Estimation Processor. Enable the Periodic Estimation Processor by clicking Run Periodic Estimation Processor on the Bulk Estimation Service’s task template. See Validation and Estimation Threads Count Settings and Chunk Size Settings for suggestions related to tuning this setting.

    Determines the number of threads managed by the Periodic Estimation Processor. Enable the Periodic Estimation Processor by clicking Run Periodic Estimation Processor on the Bulk Estimation Service’s task template. For more information, see the Validation and Estimation Threads Count Settings and Chunk Size Settings for suggestions related to tuning this setting.

    Determines the number of channels processed by each thread managed by the Scaling Estimation Processor. Enable the Scaling Estimation Processor by clicking Run Scaling Estimation Processor on the Bulk Estimation Service’s task template. For more information, see the Validation and Estimation Threads Count Settings and Chunk Size Settings for suggestions related to fine-tuning this setting.

    Determines the number of threads managed by the Scaling Estimation Processor. Enable the Scaling Estimation Processor by clicking Run Scaling Estimation Processor on the Bulk Estimation Service’s task template. For more information, see the Validation and Estimation Threads Count Settings and Chunk Size Settings for suggestions related to fine-tuning this setting.

    Defines the number of days +/- to expand the reading date range. This allows the Scaling Estimation Processor to look for register reads prior to and after the original date range. You must enable the Log Unscaled Estimates parameter to use this setting.

    For example, if you set this value to 1, the scaling process looks for register reads one day prior to and one day after the original reading date range.

    Defines the end day of the scaling window for the Scaling Estimation Processor to stop scaling the unscaled estimates. Enter a number, not a date. Use this setting in conjunction with the Scale Unscaled Estimates Window Start Day parameter.

    A valid value is a positive, non-zero integer. For example, if you enter 3 here and 5 in the window start day, you create a 5-day window starting 8 days and ending 3 days prior to midnight of the current calendar day.

    Defines the number days the Scaling Estimation Processor looks for the unscaled estimates. Valid values are integers in the range of 2 to 60. Use this setting in conjunction with the Unscaled Estimates Window End Day system setting.

    This setting allows you to create a window for the processor to begin scaling the unscaled estimates. The start day begins from the end day. For example, if your end day is 3 days ago, and you want a 5 day window, enter 5 as the start day. This creates a 5 day window counting back from the end day.

    Determines whether to start bulk estimations immediately or whether to wait until after the AMI readings import data collection window (DCW) ends. For example, IEE allows you to schedule the bulk estimation service to run after the DCW.

    • Set the value to False to start bulk estimation as soon as data arrives.

    • Set the value to True to wait for the DCW to end.

    This system setting is one of the configuration requirements for bulk estimates to run after the DCW ends. For more information refer to the help for Adding the bulk estimation service.

  • Validation

    Determines the number of channels processed by each thread managed by the Bulk Validation Processor. Enable the Bulk Validation Processor by clicking Run Bulk Validation Processor on the Bulk Validation Operation Service’s task template (Additional Setup). See Validation and Estimation Threads Count Settings and Chunk Size Settings for suggestions related to fine-tuning this setting.

    Determines the number of threads managed by the Bulk Validation Processor. Enable the Bulk Validation Processor by clicking Run Bulk Validation Processor on the Bulk Validation Operation Service’s task template (Additional Setup). See Validation and Estimation Threads Count Settings and Chunk Size Settings for suggestions related to fine-tuning this setting.

    Determines if the Cycle Task Queue is processed with the data events or the “get data availability” check.

    • When set to True, data events are generated for each validation result, which then triggers tasks for the data-driven schedules.

    • When set to False (default), the Cycle Task Queue frequently checks to see if new data is available using the “get data availability” check.

    Defines how many days forward and back IEE checks for existing data in order to define gaps during the validation process.

    Determines whether the readings validation queue loads rule statistics and allows rule filtering. Select True to enable rule statistics and rule filtering in the readings validation queue. Selecting True slows the queue load performance. Select False to disable this setting. Selecting False improves the queue load performance.

    Defines the number of days back a register read can be and still be used as the base read when calculating usage during register validation and estimation.

    Determines the number of channels processed by each thread managed by the Validation Queue Resolver. Enable the Validation Queue Resolver by selecting Run Validation Queue Resolver in the Bulk Validation Operation Service task template. For more information, see Bulk validation operation service.

    Determines the number of threads managed by the Validation Queue Resolver. Enable the Validation Queue Resolver by selecting Run Validation Queue Resolver in the Bulk Validation Operation Service task template. For more information, see Bulk validation operation service.

  • Validation Exit (VE)

    Defines the wait time in seconds between database calls for automatic bulk validation and estimation services.

    Determines whether calculated boundary reads are saved. Calculated boundary reads are computed using available register reads and interval readings solely for the purpose of validation. The most common scenario is calculating an end read from the start register and the sum of the intervals between the start read and the time stamp of the last interval. The default value is False because calculated reads are rarely used outside of the validation processes.

    Determines whether the scaling process should run within the AMI Reading Import (ARI) data collection window (DCW). Select True to run the scaling process within the DCW.

    Determines whether to attempt to calculate a missing boundary register read during a manually invoked validation or estimation. This calculation attempts to use an existing register reading that falls within the allowed time range. The Calculated Read Time Tolerance setting determines the allowed time range. If an existing register read is found, it is used as a base value and adjusted using the intervening intervals. The calculation only succeeds if the base register and all the intervening intervals are determined to be of a good data quality by virtue of their reading status.

    Calculated reads are sometimes needed when performing validation and estimation when there is no existing register read on the start or end boundary time stamp that you want. In these cases, IEE can use an existing register read that is near enough to the date range being processed and calculate a new register read at the wanted time stamp. The determination of whether the existing register read’s time stamp is near enough is determined by another system setting. Once found, IEE uses the interval readings in between the time stamp of the existing register value and the wanted time stamp to adjust the existing register read up or down as appropriate. This calculation results in an approximation of the register read which can be used in validation and estimation. This setting only determines if the reads are calculated when validation and estimation are triggered by a manual process, and not by the automatic process that is triggered by the import of data.

    The intervals used in the calculation, as well as the existing register read that is used as a base value, must not be marked with the following statuses, otherwise the calculation will not be performed: Missing, Edited, Estimated, or Estimation Needed.

    Determines how IEE handles validation when the validation set assignment changes within the reading period. Validation set assignments to a service point channel can change over time. The valid values are as follows.

    • Use Assignment At End. Select to validate the readings against the validation set that is assigned to the service point channel at the end of the reading period.

    • Use Assignment At Start. Select to validate the readings against the validation set that is assigned to the service point channel at the start of the reading period.

    Defines when the bulk estimation service begins the scaling processor. When this setting is True, the bulk scaling processor waits for ARI to complete current day processing, regardless of when ARI starts. When this setting is set to False (default), the bulk scaling service is always running, even during ARI data collection window (DCW).

  1. Click Save.