org.openimaj.hadoop.tools.twitter

Class HadoopTwitterPreprocessingTool

java.lang.Object

org.apache.hadoop.conf.Configured

org.openimaj.hadoop.mapreduce.StageRunner

org.openimaj.hadoop.tools.twitter.HadoopTwitterPreprocessingTool

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class HadoopTwitterPreprocessingTool
extends StageRunner

A hadoop implementation of twitter preprocessing

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Field Summary

Fields

Modifier and Type	Field and Description
static String	ARGS_KEY where arguments are held

Constructor Summary

Constructors

Constructor and Description
HadoopTwitterPreprocessingTool()

Method Summary

Methods

Modifier and Type	Method and Description
void	args(String[] args)
org.apache.hadoop.fs.Path[]	inputs()
static void	main(String[] args) run the tool
org.apache.hadoop.fs.Path	output()
boolean	shouldWait()
Stage<?,?,?,?,?,?,?,?>	stage()

Methods inherited from class org.openimaj.hadoop.mapreduce.StageRunner

run, runMain

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

ARGS_KEY

public static final String ARGS_KEY

where arguments are held

See Also:

Constant Field Values

Constructor Detail

HadoopTwitterPreprocessingTool

public HadoopTwitterPreprocessingTool()

Method Detail

stage

public Stage<?,?,?,?,?,?,?,?> stage()

Specified by:

stage in class StageRunner

Returns:

the stage which should be ran

output

public org.apache.hadoop.fs.Path output()

Specified by:

output in class StageRunner

Returns:

the output fed to the stage

inputs

public org.apache.hadoop.fs.Path[] inputs()
                                   throws IOException

Specified by:

inputs in class StageRunner

Returns:

the inputs fed to the stage

Throws:

IOException

args

public void args(String[] args)
          throws org.kohsuke.args4j.CmdLineException,
                 IOException

Specified by:

args in class StageRunner

Parameters:

args - arguments handed to the Tool.run(String[]). Given before outputs, inputs or stages are asked for.

Throws:

org.kohsuke.args4j.CmdLineException

IOException

shouldWait

public boolean shouldWait()

Overrides:

shouldWait in class StageRunner

Returns:

Whether this stage runner should wait for the stage to complete

main

public static void main(String[] args)
                 throws Exception

run the tool

Parameters:

args -

Throws:

Exception