|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.hadoop.mapreduce.InputFormat<K,V>
org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>
org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.BytesWritable>
org.apache.mahout.text.MultipleTextFileInputFormat
public class MultipleTextFileInputFormat
Used in combining a large number of text files into one text input reader along with the WholeFileRecordReader class.
| Nested Class Summary |
|---|
| Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat |
|---|
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter |
| Field Summary |
|---|
| Fields inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat |
|---|
SPLIT_MINSIZE_PERNODE, SPLIT_MINSIZE_PERRACK |
| Constructor Summary | |
|---|---|
MultipleTextFileInputFormat()
|
|
| Method Summary | |
|---|---|
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.BytesWritable> |
createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit,
org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
|
| Methods inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat |
|---|
createPool, createPool, getFileBlockLocations, getSplits, isSplitable, setMaxSplitSize, setMinSplitSizeNode, setMinSplitSizeRack |
| Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat |
|---|
addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Constructor Detail |
|---|
public MultipleTextFileInputFormat()
| Method Detail |
|---|
public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.BytesWritable> createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit,
org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
throws IOException
createRecordReader in class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.BytesWritable>IOException
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||