Cloud SQL

  1. Allow Change Data Capturing on Cloud SQL Databases, using Replication slots for Logical Decoding

    Companies are investing into "data lakes" supported by Kafka or Google PubSub. They typically have their data in relational databases like PostgreSQL. In order to make the change on the relational data consumable for other applications (for building caches, search engines, messaging, ...), those companies need Change Data Capturing (CDC) on their database.

    Google should allow to add a Replication Slot in the managed Cloud SQL Postgres instance (https://www.postgresql.org/docs/9.6/static/logicaldecoding-explanation.html) in order to allow to publish row changes to Kafka and/or PubSub.

    313 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    4 comments  ·  Flag idea as inappropriate…  ·  Admin →

    Today Cloud SQL for PostgreSQL launched support for change data capture and logical decoding in Public Preview. Users can now stream data for real-time analytics, perform selective replication, set up external replicas, and more. To learn more, see our blog post:

    https://cloud.google.com/blog/products/databases/you-can-now-use-cdc-from-cloudsql-for-postgresql

    Check out our release notes here:
    https://cloud.google.com/sql/docs/postgres/release-notes#June_01_2021

  2. Migration service for Postgres

    Currently the only way to migrate Postgres into Cloud SQL is to dump and restore. This necessitates downtime. We need a way to migrate Postgres DB without downtime.

    So in practice GCP needs to do a managed Bucardo service to transfer data into Cloud SQL, and subsequently we can switch the Replica status to Master status.

    10 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Cloud SQL

Categories

Feedback and Knowledge Base