backtype.storm.spout

Class KestrelThriftSpout

java.lang.Object

backtype.storm.topology.base.BaseComponent

backtype.storm.topology.base.BaseRichSpout

backtype.storm.spout.KestrelThriftSpout

All Implemented Interfaces:

backtype.storm.spout.ISpout, backtype.storm.topology.IComponent, backtype.storm.topology.IRichSpout, Serializable

public class KestrelThriftSpout
extends backtype.storm.topology.base.BaseRichSpout

This spout can be used to consume messages in a reliable way from a cluster of Kestrel servers. It is recommended that you set the parallelism hint to a multiple of the number of Kestrel servers, otherwise the read load will be higher on some Kestrel servers than others.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static int	BATCH_SIZE
static long	BLACKLIST_TIME_MS
static org.apache.log4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
KestrelThriftSpout(List<String> hosts, int port, String queueName)
KestrelThriftSpout(List<String> hosts, int port, String queueName, backtype.storm.spout.Scheme scheme)
KestrelThriftSpout(String hostname, int port, String queueName)
KestrelThriftSpout(String hostname, int port, String queueName, backtype.storm.spout.Scheme scheme)

Method Summary

Methods

Modifier and Type	Method and Description
void	ack(Object msgId)
boolean	bufferKestrelGet(int index)
void	close()
void	declareOutputFields(backtype.storm.topology.OutputFieldsDeclarer declarer)
void	fail(Object msgId)
backtype.storm.tuple.Fields	getOutputFields()
void	nextTuple()
void	open(Map conf, backtype.storm.task.TopologyContext context, backtype.storm.spout.SpoutOutputCollector collector)
void	tryEachKestrelUntilBufferFilled()

Methods inherited from class backtype.storm.topology.base.BaseRichSpout

activate, deactivate

Methods inherited from class backtype.storm.topology.base.BaseComponent

getComponentConfiguration

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface backtype.storm.topology.IComponent

getComponentConfiguration

Field Detail

LOG

public static org.apache.log4j.Logger LOG

BLACKLIST_TIME_MS

public static final long BLACKLIST_TIME_MS

See Also:

Constant Field Values

BATCH_SIZE

public static final int BATCH_SIZE

See Also:

Constant Field Values

Constructor Detail

KestrelThriftSpout

public KestrelThriftSpout(List<String> hosts,
                  int port,
                  String queueName,
                  backtype.storm.spout.Scheme scheme)

KestrelThriftSpout

public KestrelThriftSpout(String hostname,
                  int port,
                  String queueName,
                  backtype.storm.spout.Scheme scheme)

KestrelThriftSpout

public KestrelThriftSpout(String hostname,
                  int port,
                  String queueName)

KestrelThriftSpout

public KestrelThriftSpout(List<String> hosts,
                  int port,
                  String queueName)

Method Detail

getOutputFields

public backtype.storm.tuple.Fields getOutputFields()

open

public void open(Map conf,
        backtype.storm.task.TopologyContext context,
        backtype.storm.spout.SpoutOutputCollector collector)

close

public void close()

Specified by:

close in interface backtype.storm.spout.ISpout

Overrides:

close in class backtype.storm.topology.base.BaseRichSpout

bufferKestrelGet

public boolean bufferKestrelGet(int index)

tryEachKestrelUntilBufferFilled

public void tryEachKestrelUntilBufferFilled()

nextTuple

public void nextTuple()

ack

public void ack(Object msgId)

Specified by:

ack in interface backtype.storm.spout.ISpout

Overrides:

ack in class backtype.storm.topology.base.BaseRichSpout

fail

public void fail(Object msgId)

Specified by:

fail in interface backtype.storm.spout.ISpout

Overrides:

fail in class backtype.storm.topology.base.BaseRichSpout

declareOutputFields

public void declareOutputFields(backtype.storm.topology.OutputFieldsDeclarer declarer)