org.apache.spark.input

Class WholeTextFileRecordReader

Object

org.apache.hadoop.mapreduce.RecordReader<String,String>

org.apache.spark.input.WholeTextFileRecordReader

All Implemented Interfaces:

java.io.Closeable, AutoCloseable, org.apache.hadoop.conf.Configurable

public class WholeTextFileRecordReader
extends org.apache.hadoop.mapreduce.RecordReader<String,String>
implements org.apache.hadoop.conf.Configurable

A RecordReader for reading a single whole text file out in a key-value pair, where the key is the file path and the value is the entire content of the file.

Constructor Summary

Constructors

Constructor and Description
WholeTextFileRecordReader(org.apache.hadoop.mapreduce.lib.input.CombineFileSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context, Integer index)

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
org.apache.hadoop.conf.Configuration	getConf()
String	getCurrentKey()
String	getCurrentValue()
float	getProgress()
void	initialize(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
boolean	nextKeyValue()
void	setConf(org.apache.hadoop.conf.Configuration c)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WholeTextFileRecordReader

public WholeTextFileRecordReader(org.apache.hadoop.mapreduce.lib.input.CombineFileSplit split,
                         org.apache.hadoop.mapreduce.TaskAttemptContext context,
                         Integer index)

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration c)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit split,
              org.apache.hadoop.mapreduce.TaskAttemptContext context)

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<String,String>

close

public void close()

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<String,String>

getProgress

public float getProgress()

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<String,String>

getCurrentKey

public String getCurrentKey()

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<String,String>

getCurrentValue

public String getCurrentValue()

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<String,String>

nextKeyValue

public boolean nextKeyValue()

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<String,String>