org.apache.hadoop.hbase.rest

Class PerformanceEvaluation

java.lang.Object

Configured

org.apache.hadoop.hbase.rest.PerformanceEvaluation

public class PerformanceEvaluation
extends Configured

Script used evaluating Stargate performance and scalability. Runs a SG client that steps through one of a set of hardcoded tests or 'experiments' (e.g. a random reads test, a random writes test, etc.). Pass on the command-line which test to run and how many clients are participating in this experiment. Run java PerformanceEvaluation --help to obtain usage.

This class sets up and runs the evaluation programs described in Section 7, Performance Evaluation, of the Bigtable paper, pages 8-10.

If number of clients > 1, we start up a MapReduce job. Each map task runs an individual client. Each client does about 1GB of data.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	PerformanceEvaluation.Counter Enum for map metrics.
static class	PerformanceEvaluation.EvaluationMapTask MapReduce job that runs a performance evaluation client in each map task.
static class	PerformanceEvaluation.PeInputFormat InputFormat of Performance Evaluation MapReduce job.
static class	PerformanceEvaluation.PeInputSplit This class works as the InputSplit of Performance Evaluation MapReduce InputFormat, and the Record Value of RecordReader.

Field Summary

Fields

Modifier and Type	Field and Description
protected static Cluster	cluster
protected java.util.Map<java.lang.String,org.apache.hadoop.hbase.rest.PerformanceEvaluation.CmdDescriptor>	commands
static byte[]	FAMILY_NAME
static java.util.regex.Pattern	LINE_PATTERN Regex to parse lines in input file passed to mapreduce task.
protected static Logger	LOG
static byte[]	QUALIFIER_NAME
protected HTableDescriptor	TABLE_DESCRIPTOR
static TableName	TABLE_NAME

Constructor Summary

Constructors

Constructor and Description
PerformanceEvaluation(Configuration c) Constructor

Method Summary

Modifier and Type	Method and Description
protected void	addCommandDescriptor(java.lang.Class<? extends org.apache.hadoop.hbase.rest.PerformanceEvaluation.Test> cmdClass, java.lang.String name, java.lang.String description)
static byte[]	format(int number)
static byte[]	generateData(java.util.Random r, int length)
static byte[]	generateValue(java.util.Random r)
protected byte[][]	getSplits() Generates splits based on total number of rows and specified split regions
protected HTableDescriptor	getTableDescriptor()
static void	main(java.lang.String[] args)
protected void	printUsage()
protected void	printUsage(java.lang.String message)
int	run(java.lang.String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final Logger LOG

TABLE_NAME

public static final TableName TABLE_NAME

FAMILY_NAME

public static final byte[] FAMILY_NAME

QUALIFIER_NAME

public static final byte[] QUALIFIER_NAME

TABLE_DESCRIPTOR

protected HTableDescriptor TABLE_DESCRIPTOR

commands

protected java.util.Map<java.lang.String,org.apache.hadoop.hbase.rest.PerformanceEvaluation.CmdDescriptor> commands

cluster

protected static Cluster cluster

LINE_PATTERN

public static final java.util.regex.Pattern LINE_PATTERN

Regex to parse lines in input file passed to mapreduce task.

Constructor Detail

PerformanceEvaluation

public PerformanceEvaluation(Configuration c)

Constructor

Parameters:

c - Configuration object

Method Detail

addCommandDescriptor

protected void addCommandDescriptor(java.lang.Class<? extends org.apache.hadoop.hbase.rest.PerformanceEvaluation.Test> cmdClass,
                                    java.lang.String name,
                                    java.lang.String description)

getTableDescriptor

protected HTableDescriptor getTableDescriptor()

getSplits

protected byte[][] getSplits()

Generates splits based on total number of rows and specified split regions

Returns:

splits : array of byte []

format

public static byte[] format(int number)

generateData

public static byte[] generateData(java.util.Random r,
                                  int length)

generateValue

public static byte[] generateValue(java.util.Random r)

printUsage

protected void printUsage()

printUsage

protected void printUsage(java.lang.String message)

run

public int run(java.lang.String[] args)
        throws java.lang.Exception

Throws:

java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Parameters:

args -

Throws:

java.lang.Exception