spark技术分享

2014-07-09admin阅读(2429)赞(0)

RDD Caching and Persistence cache和persist都是用于将一个RDD进行缓存的，这样在之后使用的过程中就不需要重新计算了， ...

2014-07-08admin阅读(1592)赞(0)

Actions Actions are RDD operations that produce non-RDD values. They materialize a value in a Spark program. In ot ...

2014-07-07admin阅读(1396)赞(0)

PairRDDFunctions Tip Read up the scaladoc of PairRDDFunctions. PairRDDFunctions are available in RDDs of ...

2014-07-06admin阅读(1358)赞(0)

Transformations Transformations are lazy operations on a RDD that create one or many new RDDs, e.g. map, filter, ...

2014-07-05admin阅读(1206)赞(0)

Operators - Transformations and Actions RDDs have two types of operations: transformations and actions. Note ...

2014-07-04admin阅读(1351)赞(0)

ShuffledRDD ShuffledRDD is an RDD of key-value pairs that represents the shuffle step in a RDD lineage. It uses cu ...

2014-07-03admin阅读(1407)赞(0)

NewHadoopRDD NewHadoopRDD is an RDD of K keys and V values. NewHadoopRDD is created when: SparkContext.newAP ...

2014-07-02admin阅读(1746)赞(0)

HadoopRDD HadoopRDD is an RDD that provides core functionality for reading data stored in HDFS, a local file syste ...

2014-07-01admin阅读(1281)赞(0)

SubtractedRDD Caution FIXME Computing Partition (in TaskContext) — compute Method [cr ...

2014-06-30admin阅读(1755)赞(0)

CoGroupedRDD A RDD that cogroups its pair RDD parents. For each key k in parent RDDs, the resulting RDD contains a ...