Package org.apache.flink.cdc.connectors.iceberg.sink.v2

Class IcebergWriter

java.lang.Object

org.apache.flink.cdc.connectors.iceberg.sink.v2.IcebergWriter

All Implemented Interfaces:

AutoCloseable, org.apache.flink.api.connector.sink2.CommittingSinkWriter<Event,WriteResultWrapper>, org.apache.flink.api.connector.sink2.SinkWriter<Event>, org.apache.flink.api.connector.sink2.StatefulSinkWriter<Event,IcebergWriterState>

public class IcebergWriter
extends Object
implements org.apache.flink.api.connector.sink2.CommittingSinkWriter<Event,WriteResultWrapper>, org.apache.flink.api.connector.sink2.StatefulSinkWriter<Event,IcebergWriterState>

A SinkWriter for Apache Iceberg.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.SinkWriter

org.apache.flink.api.connector.sink2.SinkWriter.Context

Field Summary

Fields

Modifier and Type	Field	Description
static String	DEFAULT_FILE_FORMAT
static long	DEFAULT_MAX_FILE_SIZE

Constructor Summary

Constructors

Constructor	Description
IcebergWriter(Map<String,String> catalogOptions, int taskId, int attemptId, java.time.ZoneId zoneId, long lastCheckpointId, String jobId, String operatorId, Map<String,String> hadoopConfOptions)

Method Summary

Modifier and Type	Method	Description
void	close()
void	flush(boolean flush)
Collection<WriteResultWrapper>	prepareCommit()
List<IcebergWriterState>	snapshotState(long checkpointId)
void	write(Event event, org.apache.flink.api.connector.sink2.SinkWriter.Context context)
void	writeWatermark(org.apache.flink.api.common.eventtime.Watermark watermark)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_FILE_FORMAT

public static final String DEFAULT_FILE_FORMAT

See Also:

Constant Field Values

DEFAULT_MAX_FILE_SIZE

public static final long DEFAULT_MAX_FILE_SIZE

See Also:

Constant Field Values

Constructor Detail

IcebergWriter

public IcebergWriter(Map<String,String> catalogOptions,
                     int taskId,
                     int attemptId,
                     java.time.ZoneId zoneId,
                     long lastCheckpointId,
                     String jobId,
                     String operatorId,
                     Map<String,String> hadoopConfOptions)

Method Detail

snapshotState

public List<IcebergWriterState> snapshotState(long checkpointId)

Specified by:

snapshotState in interface org.apache.flink.api.connector.sink2.StatefulSinkWriter<Event,IcebergWriterState>

prepareCommit

public Collection<WriteResultWrapper> prepareCommit()
                                             throws IOException

Specified by:

prepareCommit in interface org.apache.flink.api.connector.sink2.CommittingSinkWriter<Event,WriteResultWrapper>

Throws:

IOException

write

public void write(Event event,
                  org.apache.flink.api.connector.sink2.SinkWriter.Context context)
           throws IOException

Specified by:

write in interface org.apache.flink.api.connector.sink2.SinkWriter<Event>

Throws:

IOException

flush

public void flush(boolean flush)
           throws IOException

Specified by:

flush in interface org.apache.flink.api.connector.sink2.SinkWriter<Event>

Throws:

IOException

writeWatermark

public void writeWatermark(org.apache.flink.api.common.eventtime.Watermark watermark)

Specified by:

writeWatermark in interface org.apache.flink.api.connector.sink2.SinkWriter<Event>

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception