org.apache.spark.rdd

Class PruneDependency<T>

Object

org.apache.spark.Dependency<T>

org.apache.spark.NarrowDependency<T>

org.apache.spark.rdd.PruneDependency<T>

All Implemented Interfaces:

java.io.Serializable

public class PruneDependency<T>
extends NarrowDependency<T>

Represents a dependency between the PartitionPruningRDD and its parent. In this case, the child RDD contains a subset of partitions of the parents'.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
PruneDependency(RDD<T> rdd, scala.Function1<Object,Object> partitionFilterFunc)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.immutable.List<Object>	getParents(int partitionId) Get the parent partitions for a child partition.
Partition[]	partitions()

Methods inherited from class org.apache.spark.NarrowDependency

rdd

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PruneDependency

public PruneDependency(RDD<T> rdd,
               scala.Function1<Object,Object> partitionFilterFunc)

Method Detail

partitions

public Partition[] partitions()

getParents

public scala.collection.immutable.List<Object> getParents(int partitionId)

Description copied from class: NarrowDependency

Get the parent partitions for a child partition.

Specified by:

getParents in class NarrowDependency<T>

Parameters:

partitionId - a partition of the child RDD

Returns:

the partitions of the parent RDD that the child partition depends upon