关注 spark技术分享,
撸spark源码 玩spark最佳实践

TaskDescription — Metadata of Single Task

TaskDescription — Metadata of Single Task

TaskDescription is a metadata of a single task with the following properties:

  • Task ID

  • Task attempt number

  • Executor ID

  • Task name

  • Task index (within the TaskSet)

  • Added files (as Map[String, Long])

  • Added JAR files (as Map[String, Long])

  • Properties

  • Serialized task (as ByteBuffer)

The name of the task is of the format:

TaskDescription is created when:

The textual representation of a TaskDescription is as follows:

Decoding TaskDescription (from Serialized Format) — decode Method

decode…​FIXME

Note

decode is used when:

Encoding TaskDescription (to Serialized Format) — encode Method

encode…​FIXME

Note

encode is used when:

  • DriverEndpoint (of CoarseGrainedSchedulerBackend) is requested to launchTasks

  • Spark on Mesos’ MesosFineGrainedSchedulerBackend is requested to createMesosTask

赞(0) 打赏
未经允许不得转载:spark技术分享 » TaskDescription — Metadata of Single Task
分享到: 更多 (0)

关注公众号:spark技术分享

联系我们联系我们

觉得文章有用就打赏一下文章作者

支付宝扫一扫打赏

微信扫一扫打赏