KnownSizeEstimation
KnownSizeEstimation is the contract that allows a class to give SizeEstimator a more accurate size estimation.
KnownSizeEstimation defines the single estimatedSize method.
|
1 2 3 4 5 6 7 8 9 |
package org.apache.spark.util trait KnownSizeEstimation { def estimatedSize: Long } |
estimatedSize is used when:
-
SizeEstimatoris requested to visitSingleObject -
BroadcastExchangeExecis requested for relationFuture -
BroadcastHashJoinExecis requested to execute -
ShuffledHashJoinExecis requested to buildHashedRelation
|
Note
|
KnownSizeEstimation is a private[spark] contract.
|
|
Note
|
HashedRelation is the only KnownSizeEstimation available.
|
spark技术分享