kafka connect

 

架設Kafka與Kafka Connect讓訊息自動同步至MongoDB

connect 說明

https://docs.confluent.io/platform/current/connect/index.html#connectors

下載 sink

https://www.confluent.io/product/connectors/?_ga=2.24281594.1343452646.1705657587-1925276915.1697595506&_gl=1*1ibzdsy*_ga*MTkyNTI3NjkxNS4xNjk3NTk1NTA2*_ga_D2D3EGKSGD*MTcwNTY1NzU4Ni4xMy4xLjE3MDU2NTc2MDQuNDIuMC4w

https://www.confluent.io/hub/mongodb/kafka-connect-mongodb

{
	"connector.class": "com.mongodb.kafka.connect.MongoSinkConnector",
	"key.converter.schemas.enable": "false",
	"database": "momoLiveDB",
	"topics": "momoLiveStream",
	"namespace.mapper.value.collection.field": "order",
	"value.converter.schemas.enable": "false",
	"connection.uri": "mongodb://10.20.43.200:27017/",
	"name": "appLiveStream",
	"value.converter": "org.apache.kafka.connect.json.JsonConverter",
	"namespace.mapper": "com.mongodb.kafka.connect.sink.namespace.mapping.FieldPathNamespaceMapper",
	"key.converter": "org.apache.kafka.connect.storage.StringConverter"
}