Daily reading summary ETL task

The DailyReadingSummary ETL task queries the IEE database for hourly and sub-hourly interval readings, aggregates the readings into daily totals, and stores those totals in a data mart table organized by channel and by day and month. The Daily Reading Summary table supports a number of IEE applications, including AMI Reading Import.

The DailyReadingSummary ETL task is designed to run once daily, typically in the early morning about an hour after reading data for the daily period is received.

Create a schedule to execute this task daily after reading data is received and the validation and estimation process have had time to complete. (System Operations > Recurring schedules overview.)

The Daily Reading Summary contains data collected from metering devices configured to record interval data. Recording devices are configured as Combined Meters in IEE.

The DailyReadingSummary ETL uses the ETL system setting LastDailyReadingSummaryETL to save the date and time of the last run. When executed in incremental mode, the ETL uses the ReceivedTime value in the Reading table to identify the newly loaded readings. In incremental mode, only new data received after the previous execution is loaded.

The DailyReadingSummary ETL task ignores readings with values equal to or greater than 1E+25. This prevents abnormally large reading values from terminating the ETL process prematurely.

Important! The DailyReadingSummary ETL depends on the FlatConfigBusiness ETL. When you initially configure IEE, execute the FlatConfigBusiness ETL first.

Use the following procedure to configure a task template:

  1. Go to System Operations > Task Management > Task Templates.

  2. Use the dropdown menu to select the Task Type and Task Template. (Click Add to create a new task template. For more information, see Adding task templates.)

  3. Configure the Task specific parameters. These parameters are defined after step 5 of this procedure.

  4. Configure the Common task template parameters. For more information, see Task template parameters.

  5. Click Save.

Task Specific Parameters

ClosedFull ETL

ClosedStart Date/End Date

Define the Start Date and End Date to set the time period for the data that the ETL task will process for the data mart. Only configure these dates if Full ETL parameter is set to True. If no dates are selected, the ETL rebuilds all available data. The time period is selected individually per service point channel. The Start and End Dates are used only when the Full ETL parameter is set to True, such as during initial system configuration.

Note: If there are partial intervals belonging to the previous day, the ETL revises the entire previous day to ensure the daily value is correct.

ClosedService Point ID

If a single service point requires updating, enter the ServicePointID value here. Only define this parameter when configuration an ad-hoc runs of the ETL task. For normal scheduled runs, leave it blank.

ClosedExecute LikeDayAlgorithm ETL

Determines whether to execute the Like Day Algorithm ETL task after the Daily Reading Summary ETL task runs. Select True to enable this setting or False to disable it. This must be set to True when using AMI Reading Import for validation and estimation or AMI Billing Export for demand response determinant calculations.