jabari
V2EX  ›  问与答

有人使用 debezium 增量同步过 mongodb 吗?

  •  
  •   jabari · Aug 13, 2021 · 1609 views
    This topic created in 1733 days ago, the information mentioned may be changed or developed.

    按照这个连接: https://debezium.io/documentation/reference/connectors/mongodb.html#mongodb-performing-a-snapshot 的说明,创建一个新名字的 connector,应该会执行 snapshot,实际上并没有同步任何数据,部分日志提示

    After applying the include/exclude list filters, no changes will be captured. Please check your configuration

    connector 配置:

    {
      "name": "mongo-material", 
      "config": {
        "connector.class": "io.debezium.connector.mongodb.MongoDbConnector", 
        "mongodb.user": "",
        "mongodb.password": "",
        "mongodb.hosts": "overseatestmongo1/10.130.84.32:10020,overseatestmongo1/10.130.84.24:10017",
        "mongodb.name": "test",   
        "MongoDB.authsource": "admin",
        "database.include.list": "db_sky",
        "collection.include.list": "db_sky.material",
        "snapshot.include.collection.list": "db_sky.material",
        "database.history.kafka.bootstrap.servers" : "kafka:9092",
        "snapshot.mode": "initial",
        "snapshot.max.threads": 2
      }
    }
    
    

    完整日志 https://gist.github.com/zhiyue/0230830edb9b07b520152fc30d0f42d8

    No Comments Yet
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   5644 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 51ms · UTC 03:38 · PVG 11:38 · LAX 20:38 · JFK 23:38
    ♥ Do have faith in what you're doing.