Package org.apache.hadoop.hbase.mapreduce

Provides HBase MapReduce Input/OutputFormats, a table indexing MapReduce job, and utility methods.

See: Description

Interface Summary

Interface	Description
VisibilityExpressionResolver	Interface to convert visibility expressions into Tags for storing along with Cells in HFiles.

Class Summary

Class	Description
CellCounter	A job with a a map and reduce phase to count cells in a table.
CellCreator	Facade to create Cells for HFileOutputFormat.
CellSerialization	Use to specify the type of serialization for the mappers and reducers
CellSerialization.CellDeserializer
CellSerialization.CellSerializer
CellSortReducer	Emits sorted Cells.
CopyTable	Tool used to copy a table to another one which can be on a different setup.
DefaultVisibilityExpressionResolver	This implementation creates tags by expanding expression using label ordinal.
Driver	Driver for hbase mapreduce jobs.
Export	Export an HBase table.
ExportUtils	Some helper methods are used by Export and org.apache.hadoop.hbase.coprocessor.Export (in hbase-endpooint).
GroupingTableMapper	Extract grouping columns from input record.
HashTable
HashTable.HashMapper
HashTable.TableHash
HFileInputFormat	Simple MR input format for HFiles.
HFileOutputFormat2	Writes HFiles.
HRegionPartitioner<KEY,VALUE>	This is used to partition the output keys into groups of keys.
IdentityTableMapper	Pass the given key and record as-is to the reduce phase.
IdentityTableReducer	Convenience class that simply writes all values (which must be Put or Delete instances) passed to it out to the configured HBase table.
Import	Import data written by Export.
Import.CellImporter	A mapper that just writes out KeyValues.
Import.CellReducer
Import.CellSortImporter
Import.CellWritableComparable
Import.CellWritableComparable.CellWritableComparator
Import.CellWritableComparablePartitioner
Import.Importer	Write table content out to files in hdfs.
Import.KeyValueImporter	Deprecated Use Import.CellImporter.
Import.KeyValueReducer	Deprecated Use Import.CellReducer.
Import.KeyValueSortImporter	Deprecated Use Import.CellSortImporter.
Import.KeyValueWritableComparable
Import.KeyValueWritableComparable.KeyValueWritableComparator
Import.KeyValueWritableComparablePartitioner	Deprecated Use Import.CellWritableComparablePartitioner.
ImportTsv	Tool to import data from a TSV file.
ImportTsv.TsvParser
IntegrationTestBulkLoad	Test Bulk Load and MR on a distributed cluster.
IntegrationTestBulkLoad.CompositeKeyComparator	Comparator used to order linkKeys so that they are passed to a reducer in order.
IntegrationTestBulkLoad.EmptySplit
IntegrationTestBulkLoad.FixedRecordReader<K,V>
IntegrationTestBulkLoad.ITBulkLoadInputFormat
IntegrationTestBulkLoad.LinkChain	Writable used as the value emitted from a pass over the hbase table.
IntegrationTestBulkLoad.LinkedListCheckingMapper	Mapper to pass over the table.
IntegrationTestBulkLoad.LinkedListCheckingReducer	Class that does the actual checking of the links.
IntegrationTestBulkLoad.LinkedListCreationMapper	Mapper that creates a linked list of KeyValues.
IntegrationTestBulkLoad.LinkKey	Writable class used as the key to group links in the linked list.
IntegrationTestBulkLoad.NaturalKeyGroupingComparator	Comparator used to figure out if a linkKey should be grouped together.
IntegrationTestBulkLoad.NaturalKeyPartitioner	Class to figure out what partition to send a link in the chain to.
IntegrationTestBulkLoad.SlowMeCoproScanOperations
IntegrationTestImportTsv	Validate ImportTsv + LoadIncrementalHFiles on a distributed cluster.
IntegrationTestTableMapReduceUtil	Test that we add tmpjars correctly including the named dependencies.
IntegrationTestTableSnapshotInputFormat	An integration test to test TableSnapshotInputFormat which enables reading directly from snapshot files without going through hbase servers.
JarFinder	Finds the Jar for a class.
KeyValueSerialization	Deprecated Use CellSerialization.
KeyValueSerialization.KeyValueDeserializer
KeyValueSerialization.KeyValueSerializer
KeyValueSortReducer	Deprecated Use CellSortReducer.
LoadIncrementalHFiles	Deprecated As of release 2.0.0, this will be removed in HBase 3.0.0.
LoadIncrementalHFiles.LoadQueueItem	Deprecated As of release 2.0.0, this will be removed in HBase 3.0.0.
MultiTableHFileOutputFormat	Create 3 level tree directory, first level is using table name as parent directory and then use family name as child directory, and all related HFiles for one family are under child directory -tableName1 -columnFamilyName1 -columnFamilyName2 -HFiles -tableName2 -columnFamilyName1 -HFiles -columnFamilyName2
MultiTableInputFormat	Convert HBase tabular data from multiple scanners into a format that is consumable by Map/Reduce.
MultiTableInputFormatBase	A base for MultiTableInputFormats.
MultiTableInputFormatTestBase	Base set of tests and setup for input formats touching multiple tables.
MultiTableInputFormatTestBase.ScanMapper	Pass the key and value to reducer.
MultiTableInputFormatTestBase.ScanReducer	Checks the last and first keys seen against the scanner boundaries.
MultiTableOutputFormat	Hadoop output format that writes to one or more HBase tables.
MultiTableOutputFormat.MultiTableRecordWriter	Record writer for outputting to multiple HTables.
MultiTableSnapshotInputFormat	MultiTableSnapshotInputFormat generalizes TableSnapshotInputFormat allowing a MapReduce job to run over one or more table snapshots, with one or more scans configured for each.
MultiTableSnapshotInputFormatImpl	Shared implementation of mapreduce code over multiple table snapshots.
MultithreadedTableMapper<K2,V2>	Multithreaded implementation for @link org.apache.hbase.mapreduce.TableMapper
MutationSerialization
NMapInputFormat	Input format that creates a configurable number of map tasks each provided with a single row of NullWritables.
PutCombiner<K>	Combine Puts.
PutSortReducer	Emits sorted Puts.
RegionSizeCalculator	Computes size of each region for given table and given column families.
ResultSerialization
RowCounter	A job with a just a map phase to count rows.
SimpleTotalOrderPartitioner<VALUE>	A partitioner that takes start and end keys and uses bigdecimal to figure which reduce a key belongs to.
SyncTable
SyncTable.SyncMapper
TableInputFormat	Convert HBase tabular data into a format that is consumable by Map/Reduce.
TableInputFormatBase	A base for TableInputFormats.
TableMapper<KEYOUT,VALUEOUT>	Extends the base Mapper class to add the required input key and value classes.
TableMapReduceUtil	Utility for TableMapper and TableReducer
TableOutputCommitter	Small committer class that does not do anything.
TableOutputFormat<KEY>	Convert Map/Reduce output and write it to an HBase table.
TableRecordReader	Iterate over an HBase table data, return (ImmutableBytesWritable, Result) pairs.
TableRecordReaderImpl	Iterate over an HBase table data, return (ImmutableBytesWritable, Result) pairs.
TableReducer<KEYIN,VALUEIN,KEYOUT>	Extends the basic Reducer class to add the required key and value input/output classes.
TableSnapshotInputFormat	TableSnapshotInputFormat allows a MapReduce job to run over a table snapshot.
TableSnapshotInputFormat.TableSnapshotRegionSplit
TableSnapshotInputFormatImpl	Hadoop MR API-agnostic implementation for mapreduce over table snapshots.
TableSnapshotInputFormatImpl.InputSplit	Implementation class for InputSplit logic common between mapred and mapreduce.
TableSnapshotInputFormatImpl.RecordReader	Implementation class for RecordReader logic common between mapred and mapreduce.
TableSnapshotInputFormatTestBase
TableSplit	A table split corresponds to a key range (low, high) and an optional scanner.
TestCellBasedHFileOutputFormat2	Simple test for HFileOutputFormat2.
TestCellBasedImportExport2	Tests the table import and table export MR job functionality
TestCellBasedWALPlayer2	Basic test for the WALPlayer M/R tool
TestCellCounter
TestCopyTable	Basic test for the CopyTable M/R tool
TestGroupingTableMapper
TestHashTable	Basic test for the HashTable M/R tool
TestHBaseMRTestingUtility
TestHFileOutputFormat2	Simple test for HFileOutputFormat2.
TestHRegionPartitioner
TestImportExport	Tests the table import and table export MR job functionality
TestImportTsv
TestImportTsvParser	Tests for ImportTsv.TsvParser.
TestImportTSVWithOperationAttributes
TestImportTSVWithOperationAttributes.OperationAttributesTestController
TestImportTSVWithTTLs
TestImportTSVWithTTLs.TTLCheckingObserver
TestImportTSVWithVisibilityLabels
TestJarFinder	This file was forked from hadoop/common/branches/branch-2@1350012.
TestMultiTableInputFormat	Tests various scan start and stop row scenarios.
TestMultiTableInputFormatBase	Tests of MultiTableInputFormatBase.
TestMultiTableInputFormatBase.MRSplitsConnection	Connection to use above in Test.
TestMultiTableSnapshotInputFormat
TestMultiTableSnapshotInputFormatImpl
TestMultiTableSnapshotInputFormatImpl.ScanWithEquals
TestMultithreadedTableMapper	Test Map/Reduce job over HBase tables.
TestMultithreadedTableMapper.ProcessContentsMapper	Pass the given key and processed record reduce
TestRegionSizeCalculator
TestRowCounter	Test the rowcounter map reduce job.
TestSimpleTotalOrderPartitioner	Test of simple partitioner.
TestSyncTable	Basic test for the SyncTable M/R tool
TestTableInputFormat	This tests the TableInputFormat and its recovery semantics
TestTableInputFormat.ExampleDeprecatedTIF
TestTableInputFormat.ExampleJobConfigurableTIF
TestTableInputFormat.ExampleTIF
TestTableInputFormat.ExampleVerifier
TestTableInputFormatBase
TestTableInputFormatScan1	TestTableInputFormatScan part 1.
TestTableInputFormatScan2	TestTableInputFormatScan part 2.
TestTableInputFormatScanBase	Tests various scan start and stop row scenarios.
TestTableInputFormatScanBase.ScanMapper	Pass the key and value to reduce.
TestTableInputFormatScanBase.ScanReducer	Checks the last and first key seen against the scanner boundaries.
TestTableMapReduce	Test Map/Reduce job over HBase tables.
TestTableMapReduceBase	A base class for a test Map/Reduce job over HBase tables.
TestTableMapReduceUtil	Test different variants of initTableMapperJob method
TestTableSnapshotInputFormat
TestTableSnapshotInputFormat.TestTableSnapshotMapper
TestTableSnapshotInputFormat.TestTableSnapshotReducer
TestTableSplit
TestTimeRangeMapRed
TestWALPlayer	Basic test for the WALPlayer M/R tool
TestWALRecordReader	JUnit tests for the WALRecordReader
TextSortReducer	Emits Sorted KeyValues.
TsvImporterCustomTestMapper	Dummy mapper used for unit tests to verify that the mapper can be injected.
TsvImporterCustomTestMapperForOprAttr	Just shows a simple example of how the attributes can be extracted and added to the puts
TsvImporterMapper	Write table content out to files in hdfs.
TsvImporterTextMapper	Write table content out to map output files.
WALInputFormat	Simple InputFormat for org.apache.hadoop.hbase.wal.WAL files.
WALPlayer	A tool to replay WAL files as a M/R job.
WALPlayer.WALMapper	A mapper that writes out Mutation to be directly applied to a running HBase instance.

Enum Summary

Enum	Description
SyncTable.SyncMapper.Counter
TestTableSnapshotInputFormat.TestTableSnapshotCounters

Exception Summary

Exception	Description
ImportTsv.TsvParser.BadTsvLineException

Package org.apache.hadoop.hbase.mapreduce Description

Provides HBase MapReduce Input/OutputFormats, a table indexing MapReduce job, and utility methods.

See HBase and MapReduce in the HBase Reference Guide for mapreduce over hbase documentation.