Package cz.o2.proxima.direct.io.bulkfs.parquet

Class ProximaParquetWriter

java.lang.Object

cz.o2.proxima.direct.io.bulkfs.parquet.ProximaParquetWriter

All Implemented Interfaces:

Writer, java.io.Closeable, java.lang.AutoCloseable

@Internal
public class ProximaParquetWriter
extends java.lang.Object
implements Writer

Writer for writing data in parquet format.

Constructor Summary

Constructors

Constructor	Description
ProximaParquetWriter(Path path, org.apache.parquet.schema.MessageType schema, java.lang.String attributeNamesPrefix, org.apache.parquet.hadoop.metadata.CompressionCodecName compressionCodecName, org.apache.hadoop.conf.Configuration config)

Method Summary

Modifier and Type	Method	Description
void	close()	Close and flush the writer to target FileSystem.
Path	getPath()	Get Path associated with the Writer.
void	write(StreamElement elem)	Write StreamElement into this blob store.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ProximaParquetWriter

public ProximaParquetWriter(Path path,
                            org.apache.parquet.schema.MessageType schema,
                            java.lang.String attributeNamesPrefix,
                            org.apache.parquet.hadoop.metadata.CompressionCodecName compressionCodecName,
                            org.apache.hadoop.conf.Configuration config)
                     throws java.io.IOException

Throws:

java.io.IOException

Method Detail

write

public void write(StreamElement elem)
           throws java.io.IOException

Description copied from interface: Writer

Write StreamElement into this blob store.

Specified by:

write in interface Writer

Parameters:

elem - the element to write

Throws:

java.io.IOException - on errors

close

public void close()
           throws java.io.IOException

Description copied from interface: Writer

Close and flush the writer to target FileSystem. Note that the associated Path might be visible on the target FileSystem only after closing associated writer.

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface Writer

Throws:

java.io.IOException - on errors

getPath

public Path getPath()

Description copied from interface: Writer

Get Path associated with the Writer.

Specified by:

getPath in interface Writer

Returns:

the path of this writer