Package cz.o2.proxima.beam.core.direct.io

Class BatchLogRead

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<StreamElement>>

cz.o2.proxima.beam.core.direct.io.BatchLogRead

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

public class BatchLogRead
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<StreamElement>>

A PTransform that reads from a BatchLogReader using splittable DoFn.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	BatchLogRead.BatchLogReadOptionsFactory
static interface	BatchLogRead.BatchLogReadPipelineOptions

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

annotations, displayData, name, resourceHints

Method Summary

Modifier and Type	Method	Description
org.apache.beam.sdk.values.PCollection<StreamElement>	expand(org.apache.beam.sdk.values.PBegin input)
static BatchLogRead	of(java.util.List<AttributeDescriptor<?>> attributes, long limit, RepositoryFactory repositoryFactory, BatchLogReader reader, long startStamp, long endStamp, java.util.Map<java.lang.String,java.lang.Object> cfg)	Create the BatchLogRead transform that reads from BatchLogReader in batch manner.
static BatchLogRead	of(java.util.List<AttributeDescriptor<?>> attributes, long limit, Repository repo, BatchLogReader reader)	Create the BatchLogRead transform that reads from BatchLogReader in batch manner.
static BatchLogRead	of(java.util.List<AttributeDescriptor<?>> attributes, long limit, Repository repo, BatchLogReader reader, long startStamp, long endStamp)	Create the BatchLogRead transform that reads from BatchLogReader in batch manner.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

of

public static BatchLogRead of(java.util.List<AttributeDescriptor<?>> attributes,
                              long limit,
                              Repository repo,
                              BatchLogReader reader)

Create the BatchLogRead transform that reads from BatchLogReader in batch manner.

Parameters:

attributes - the attributes to read

limit - limit (use Long.MAX_VALUE for unbounded

repo - repository

reader - the reader

Returns:

BatchLogRead transform for the commit log

of

public static BatchLogRead of(java.util.List<AttributeDescriptor<?>> attributes,
                              long limit,
                              Repository repo,
                              BatchLogReader reader,
                              long startStamp,
                              long endStamp)

Create the BatchLogRead transform that reads from BatchLogReader in batch manner.

Parameters:

attributes - the attributes to read

limit - limit (use Long.MAX_VALUE for unbounded

repo - repository

reader - the reader

startStamp - starting stamp (inclusive)

endStamp - ending stamp (exclusive)

Returns:

BatchLogRead transform for the commit log

of

public static BatchLogRead of(java.util.List<AttributeDescriptor<?>> attributes,
                              long limit,
                              RepositoryFactory repositoryFactory,
                              BatchLogReader reader,
                              long startStamp,
                              long endStamp,
                              java.util.Map<java.lang.String,java.lang.Object> cfg)

Create the BatchLogRead transform that reads from BatchLogReader in batch manner.

Parameters:

attributes - the attributes to read

limit - limit (use Long.MAX_VALUE for unbounded

repositoryFactory - repository factory

reader - the reader

startStamp - starting stamp (inclusive)

endStamp - ending stamp (exclusive)

cfg - configuration of the family

Returns:

CommitLogRead transform for the commit log

expand

public org.apache.beam.sdk.values.PCollection<StreamElement> expand(org.apache.beam.sdk.values.PBegin input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,org.apache.beam.sdk.values.PCollection<StreamElement>>