public class StreamBulkProcessor extends Object implements StreamProcessorTopology
BulkCommand
and produce document ids. This scroller takes a query to execute on
DB (by scrolling) and then produce document id to the appropriate stream.Modifier and Type | Class and Description |
---|---|
static class |
StreamBulkProcessor.BulkDocumentScrollerComputation |
static class |
StreamBulkProcessor.CounterComputation |
static class |
StreamBulkProcessor.KeyValueWriterComputation |
Modifier and Type | Field and Description |
---|---|
static String |
AVRO_CODEC |
static String |
BUCKET_SIZE_OPT |
static String |
COUNTER_COMPUTATION_NAME |
static String |
COUNTER_STREAM_NAME |
static String |
COUNTER_THRESHOLD_MS_OPT |
static int |
DEFAULT_BUCKET_SIZE |
static int |
DEFAULT_COUNTER_THRESHOLD_MS |
static int |
DEFAULT_SCROLL_BATCH_SIZE |
static int |
DEFAULT_SCROLL_KEEPALIVE_SECONDS |
static String |
KVWRITER_COMPUTATION_NAME |
static String |
KVWRITER_STREAM_NAME |
static String |
SCROLL_BATCH_SIZE_OPT |
static String |
SCROLL_KEEP_ALIVE_SECONDS_OPT |
static String |
SCROLLER_COMPUTATION_NAME |
Constructor and Description |
---|
StreamBulkProcessor() |
Modifier and Type | Method and Description |
---|---|
protected int |
getOptionAsInteger(Map<String,String> options,
String option,
int defaultValue) |
Topology |
getTopology(Map<String,String> options)
Returns a Stream computation topology.
|
public static final String AVRO_CODEC
public static final String SCROLLER_COMPUTATION_NAME
public static final String COUNTER_COMPUTATION_NAME
public static final String KVWRITER_COMPUTATION_NAME
public static final String COUNTER_STREAM_NAME
public static final String KVWRITER_STREAM_NAME
public static final String SCROLL_BATCH_SIZE_OPT
public static final String SCROLL_KEEP_ALIVE_SECONDS_OPT
public static final String BUCKET_SIZE_OPT
public static final String COUNTER_THRESHOLD_MS_OPT
public static final int DEFAULT_SCROLL_BATCH_SIZE
public static final int DEFAULT_SCROLL_KEEPALIVE_SECONDS
public static final int DEFAULT_BUCKET_SIZE
public static final int DEFAULT_COUNTER_THRESHOLD_MS
public StreamBulkProcessor()
public Topology getTopology(Map<String,String> options)
StreamProcessorTopology
getTopology
in interface StreamProcessorTopology
protected int getOptionAsInteger(Map<String,String> options, String option, int defaultValue)
Copyright © 2018 Nuxeo. All rights reserved.