Viewing Historical Job Information¶
Scenario¶
Query the execution status and execution duration of a Loader job during routine maintenance. You can perform the following operations on the job:
Dirty Data: Query data that fails to be processed or data that is filtered out during job execution, and check which source data does not meet transformation or cleaning rules.
Logs: Query log information about job execution in MapReduce.
Prerequisites¶
You have obtained the username and password for logging in to the Loader WebUI.
Procedure¶
Access the Loader web UI.
Log in to FusionInsight Manager. For details, see Accessing FusionInsight Manager.
Choose Cluster > Name of the desired cluster > Services > Loader.
Click LoaderServer(Node name, Active). The Loader web UI is displayed.
Figure 1 Loader web UI¶
Query historical records of a Loader job.
Locate the row that contains the job to be viewed.
As shown in the following figure, click History to view the job execution history.
Figure 2 Viewing historical records¶
Table 1 Parameters¶ Name
Description
Rows/Files Read
Indicates the number of rows (files) read from the input source.
Rows/Files Written
Number of rows (files) written to the output source.
Rows/Files Overridden
Indicates the number of bad rows (files) recorded during transformation. The input format is incorrect, so transformation cannot be performed.
Number of rows that are skipped after filtering conditions are configured during conversion.