KnownSizeEstimation
KnownSizeEstimation
is the contract that allows a class to give SizeEstimator a more accurate size estimation.
KnownSizeEstimation
defines the single estimatedSize
method.
1 2 3 4 5 6 7 8 9 |
package org.apache.spark.util trait KnownSizeEstimation { def estimatedSize: Long } |
estimatedSize
is used when:
-
SizeEstimator
is requested to visitSingleObject -
BroadcastExchangeExec
is requested for relationFuture -
BroadcastHashJoinExec
is requested to execute -
ShuffledHashJoinExec
is requested to buildHashedRelation
Note
|
KnownSizeEstimation is a private[spark] contract.
|
Note
|
HashedRelation is the only KnownSizeEstimation available.
|