spark技术分享CoGroupedRDD
A RDD that cogroups its pair RDD parents. For each key k in parent RDDs, the resulting RDD contains a tuple with the list of values for that key.
Use RDD.cogroup(…) to create one.
getDependencies Method
|
Caution
|
FIXME |
Computing Partition (in TaskContext) — compute Method
|
1 2 3 4 5 |
compute(s: Partition, context: TaskContext): Iterator[(K, Array[Iterable[_]])] |
|
Note
|
compute is part of RDD Contract to compute a partition (in a TaskContext).
|
compute…FIXME
