Reading data purge
Use the following procedure to configure a task template:
-
Go to System Operations > Task Management > Task Templates.
-
Use the dropdown menu to select the Task Type and Task Template. (Click Add to create a new task template. For more information, see Adding task templates.)
-
Configure the Task specific parameters. These parameters are defined after step 5 of this procedure.
-
Configure the Common task template parameters. For more information, see Task template parameters.
-
Click Save.
Task specific parameters:
Processing Chunk Size
Defines the number of configuration entities processed by sub-tasks. IEE groups the data that was processed by the task into separate batches of the size you designate here. IEE considers the task completed when all child tasks are finished, and each has reported back to the parent tasks.
Chunk size is a parameter common to several task templates. The higher the chunk size value, the greater the portion of the total available work each IEE task runner performs. A smaller value means dividing the work between more concurrent task runners.
Chunk sizes that are too large overburden a few task runners, while other task runners sit idle. In extreme cases, overly large chunk sizes could result in system failure due to lack of available, allocated memory. Chunk sizes that are too small spawn many task runners that perform more initialization and shutdown than actual work. Both large and small extremes will cause delays in export processing.
When fine tuning chunk sizes, consider database resources, hardware requirements, daily processing levels, and processing windows. Adjust values over time, as hardware and networking conditions change.
File Type
Define the file type for the task by selecting a type from the dropdown list. These are the types of files available for this task. For example, the task may be able to create or import file types such as CSV, XML, XLS, and others.
External System
Defines any external system to which IEE configuration data can be associated. In many places this parameter provides you with the dropdown menu to select from the external systems configured in the External System table.
Export File Name
Defines the export file name. You can enter a unique file name or accept the default. This parameter supports the standard IEE macros.
Export Directory
Defines the directory where IEE places the file containing exported data. Accept the IEE default file path or click Search to browse to a directory. This parameter supports the standard IEE macros. Reference as ($ExportDirectory) when configuring a task. Exported data is generated by an export task template or an export API.
Command Text
In a custom export, the command text parameters can contain one or more database statements, or the name of a stored procedure. The output writes to the output file. The command text parameter has a different format for SQL Server and for Oracle. If the SQL Server command is used in an Oracle database environment, an Oracle error message is returned. Always use the correct syntax for your database.
In the case of the Reading Data Purge task template, the command text configures how often IEE should run the data purge. Running the Reading Data Purge from the task scheduler can time out before completing the task.
If running the Reading Data Purge from the database, see the following examples of command text syntax for Oracle and SQL Server.
Oracle example:
var rc refcursor;
exec reading_purge (DaysToKeep => 365, SPIDList => null, IncludeTableCounts => 0 , Scheduled =>1, records=>:rc);
SQL Server example:
reading_purge 365 -- @DaysToKeep: number of days of Reading data to keep, starting backward from the current date/time
, null -- @SPIDList: list of ServicePointID values, use default of null to indicate all ServicePoints
, 0 -- @IncludeTableCounts: Leave set to 0 to avoid excessively long run times for the purge
, 1 -- @Scheduled: Leave set to 1 to commit the deletions