Real-Time Data Integration Made Easy
One Connect Snowflake JDBC connector facilitates the real-time transfer of data from Apache Kafka® topics on Confluent’s data streaming platform for writing to Snowflake Tables based on topic subscriptions. It enables idempotent writes with upserts and supports the auto-creation of tables and auto-evolution using schema registry. This enables the ingestion of both historical and real-time data, which can then be processed using any of the available Confluent sink connectors. By establishing this connection, businesses can efficiently transfer data to other applications, databases, and analytics platforms, ensuring that the information is always up-to-date and available for endless, real-time use cases.
One Connect Snowflake Sink Connector – Features
Idempotent writes
The default insert.mode is INSERT. If it is configured as UPSERT, the connector will use upsert semantics rather than plain insert statements. Upsert semantics refer to atomically adding a new row or updating the existing row if there is a primary key constraint violation, which provides idempotence.
Schemas
The connector supports Avro input format for Key and Value. Schema Registry must be enabled to use a Schema Registry-based format
Table and column auto-creation
Auto.create and auto-evolve are supported. If tables or columns are missing, they can be created automatically. Table names are created based on Kafka topic names.
Raw data
The connector supports sinking raw data to Snowflake when insert.mode is INSERT and pk.mode is none.
Not yet a Confluent Customer?
Start your free trial of Confluent Cloud today. New signups receive $400 to spend during their first 30 days—no credit card required.
