org.apache.spark.sql.columnar

Class InMemoryColumnarTableScan

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.columnar.InMemoryColumnarTableScan

All Implemented Interfaces:

java.io.Serializable, Logging, org.apache.spark.sql.catalyst.trees.LeafNode<SparkPlan>, scala.Equals, scala.Product

public class InMemoryColumnarTableScan
extends SparkPlan
implements LeafNode, scala.Product, scala.Serializable

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
InMemoryColumnarTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> attributes, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> predicates, InMemoryRelation relation)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	attributes()
scala.PartialFunction<org.apache.spark.sql.catalyst.expressions.Expression,org.apache.spark.sql.catalyst.expressions.Expression>	buildFilter()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Runs this query returning the result as an RDD.
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	output()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	partitionFilters()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	predicates()
Accumulator<Object>	readBatches()
Accumulator<Object>	readPartitions()
InMemoryRelation	relation()
SQLContext	sqlContext() A handle to the SQL Context that was used to create this plan.

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

codegenEnabled, executeCollect, makeCopy, outputPartitioning, requiredChildDistribution

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, inputSet, missingInput, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, printSchema, references, schema, schemaString, simpleString, statePrefix, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, map, mapChildren, nodeName, numberedTreeString, otherCopyArgs, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.LeafNode

children

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

InMemoryColumnarTableScan

public InMemoryColumnarTableScan(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> attributes,
                         scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> predicates,
                         InMemoryRelation relation)

Method Detail

attributes

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> attributes()

predicates

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> predicates()

relation

public InMemoryRelation relation()

sqlContext

public SQLContext sqlContext()

Description copied from class: SparkPlan

A handle to the SQL Context that was used to create this plan. Since many operators need access to the sqlContext for RDD operations or configuration this field is automatically populated by the query planning infrastructure.

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()

Specified by:

output in class org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

buildFilter

public scala.PartialFunction<org.apache.spark.sql.catalyst.expressions.Expression,org.apache.spark.sql.catalyst.expressions.Expression> buildFilter()

partitionFilters

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> partitionFilters()

readPartitions

public Accumulator<Object> readPartitions()

readBatches

public Accumulator<Object> readBatches()

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Description copied from class: SparkPlan

Runs this query returning the result as an RDD.

Specified by:

execute in class SparkPlan