Package cz.o2.proxima.direct.io.hadoop

Class HadoopDataAccessor

java.lang.Object

cz.o2.proxima.direct.io.hadoop.HadoopDataAccessor

All Implemented Interfaces:

AbstractDataAccessor, DataAccessor, java.io.Serializable

public class HadoopDataAccessor
extends java.lang.Object
implements DataAccessor

DataAccessor for Hadoop Distributed FileSystem.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
static java.lang.String	HADOOP_ALLOWED_LATENESS
static java.lang.String	HADOOP_BATCH_PROCESS_SIZE_MIN
static java.lang.String	HADOOP_ROLL_INTERVAL
static java.lang.String	TMP_FS

Constructor Summary

Constructors

Constructor	Description
HadoopDataAccessor(AttributeFamilyDescriptor family)

Method Summary

Modifier and Type	Method	Description
boolean	equals(java.lang.Object obj)
long	getAllowedLateness()
java.util.Optional<BatchLogReader>	getBatchLogReader(Context context)	Retrieve batch log reader.
long	getBatchProcessSize()
java.util.Map<java.lang.String,java.lang.Object>	getCfg()
EntityDescriptor	getEntityDesc()
FileFormat	getFormat()
cz.o2.proxima.direct.io.hadoop.HadoopFileSystem	getHadoopFs()
NamingConvention	getNamingConvention()
long	getRollInterval()
cz.o2.proxima.direct.io.hadoop.HadoopFileSystem	getTemporaryHadoopFs()
NamingConvention	getTemporaryNamingConvention()
java.net.URI	getUri()	Retrieve URI associated with this AbstractDataAccessor.
java.net.URI	getUriRemapped()
java.util.Optional<AttributeWriterBase>	getWriter(Context context)	Retrieve writer (if applicable).
int	hashCode()
java.lang.String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface cz.o2.proxima.direct.core.DataAccessor

getCachedView, getCommitLogReader, getRandomAccessReader, isAcceptable

Field Detail

HADOOP_ROLL_INTERVAL

public static final java.lang.String HADOOP_ROLL_INTERVAL

See Also:

Constant Field Values

HADOOP_BATCH_PROCESS_SIZE_MIN

public static final java.lang.String HADOOP_BATCH_PROCESS_SIZE_MIN

See Also:

Constant Field Values

HADOOP_ALLOWED_LATENESS

public static final java.lang.String HADOOP_ALLOWED_LATENESS

See Also:

Constant Field Values

TMP_FS

public static final java.lang.String TMP_FS

See Also:

Constant Field Values

Constructor Detail

HadoopDataAccessor

public HadoopDataAccessor(AttributeFamilyDescriptor family)

Method Detail

getCfg

public java.util.Map<java.lang.String,java.lang.Object> getCfg()

getWriter

public java.util.Optional<AttributeWriterBase> getWriter(Context context)

Description copied from interface: DataAccessor

Retrieve writer (if applicable).

Specified by:

getWriter in interface DataAccessor

Parameters:

context - the serializable context provided by repository

Returns:

optional AttributeWriterBase of this accessor

getBatchLogReader

public java.util.Optional<BatchLogReader> getBatchLogReader(Context context)

Description copied from interface: DataAccessor

Retrieve batch log reader.

Specified by:

getBatchLogReader in interface DataAccessor

Parameters:

context - serializable context provided by repository

Returns:

optional BatchLogReader of this accessor

hashCode

public int hashCode()

Overrides:

hashCode in class java.lang.Object

equals

public boolean equals(java.lang.Object obj)

Overrides:

equals in class java.lang.Object

getUriRemapped

public java.net.URI getUriRemapped()

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

getEntityDesc

public EntityDescriptor getEntityDesc()

getUri

public java.net.URI getUri()

Description copied from interface: AbstractDataAccessor

Retrieve URI associated with this AbstractDataAccessor.

Specified by:

getUri in interface AbstractDataAccessor

Returns:

URI representing this accessor

getRollInterval

public long getRollInterval()

getBatchProcessSize

public long getBatchProcessSize()

getFormat

public FileFormat getFormat()

getNamingConvention

public NamingConvention getNamingConvention()

getTemporaryNamingConvention

public NamingConvention getTemporaryNamingConvention()

getHadoopFs

public cz.o2.proxima.direct.io.hadoop.HadoopFileSystem getHadoopFs()

getTemporaryHadoopFs

public cz.o2.proxima.direct.io.hadoop.HadoopFileSystem getTemporaryHadoopFs()

getAllowedLateness

public long getAllowedLateness()