org.apache.spark.streaming.scheduler

Class BatchInfo

Object

org.apache.spark.streaming.scheduler.BatchInfo

All Implemented Interfaces:

java.io.Serializable, scala.Equals, scala.Product

public class BatchInfo
extends Object
implements scala.Product, scala.Serializable

:: DeveloperApi :: Class having information on completed batches.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
BatchInfo(Time batchTime, scala.collection.immutable.Map<Object,ReceivedBlockInfo[]> receivedBlockInfo, long submissionTime, scala.Option<Object> processingStartTime, scala.Option<Object> processingEndTime)

Method Summary

Methods

Modifier and Type	Method and Description
Time	batchTime()
scala.Option<Object>	processingDelay() Time taken for the all jobs of this batch to finish processing from the time they started processing.
scala.Option<Object>	processingEndTime()
scala.Option<Object>	processingStartTime()
scala.collection.immutable.Map<Object,ReceivedBlockInfo[]>	receivedBlockInfo()
scala.Option<Object>	schedulingDelay() Time taken for the first job of this batch to start processing from the time this batch was submitted to the streaming scheduler.
long	submissionTime()
scala.Option<Object>	totalDelay() Time taken for all the jobs of this batch to finish processing from the time they were submitted.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Constructor Detail

BatchInfo

public BatchInfo(Time batchTime,
         scala.collection.immutable.Map<Object,ReceivedBlockInfo[]> receivedBlockInfo,
         long submissionTime,
         scala.Option<Object> processingStartTime,
         scala.Option<Object> processingEndTime)

Method Detail

batchTime

public Time batchTime()

receivedBlockInfo

public scala.collection.immutable.Map<Object,ReceivedBlockInfo[]> receivedBlockInfo()

submissionTime

public long submissionTime()

processingStartTime

public scala.Option<Object> processingStartTime()

processingEndTime

public scala.Option<Object> processingEndTime()

schedulingDelay

public scala.Option<Object> schedulingDelay()

Time taken for the first job of this batch to start processing from the time this batch was submitted to the streaming scheduler. Essentially, it is processingStartTime - submissionTime.

processingDelay

public scala.Option<Object> processingDelay()

Time taken for the all jobs of this batch to finish processing from the time they started processing. Essentially, it is processingEndTime - processingStartTime.

totalDelay

public scala.Option<Object> totalDelay()

Time taken for all the jobs of this batch to finish processing from the time they were submitted. Essentially, it is processingDelay + schedulingDelay.