spark技术分享Jobs Tab
Jobs tab in web UI shows status of all Spark jobs in a Spark application (i.e. a SparkContext).
The Jobs tab is available under /jobs URL, i.e. http://localhost:4040/jobs.
The Jobs tab consists of two pages, i.e. All Jobs and Details for Job pages.
Internally, the Jobs tab is represented by JobsTab.
Details for Job — JobPage Page
When you click a job in AllJobsPage, you see the Details for Job page.
JobPage is a WebUIPage that shows statistics and stage list for a given job.
Details for Job page is registered under /job URL, i.e. http://localhost:4040/jobs/job/?id=0 and accepts one mandatory id request parameter as a job identifier.
When a job id is not found, you should see “No information to display for job ID” message.
JobPage displays the job’s status, group (if available), and the stages per state: active, pending, completed, skipped, and failed.
|
Note
|
A job can be in a running, succeeded, failed or unknown state. |
