Cloud Pub/Sub

Welcome to the Google Cloud Pub/Sub idea forum. You can submit and vote on ideas here to tell the Pub/Sub team which features you’d like to see.

This forum is for feature suggestions. If you’re looking for help forums, look here:

We can’t wait to hear from you!

How can we improve Cloud Pub/Sub?

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. Add Retry Count to Pub/Sub

    The way we plan to work with Pub/Sub is by pulling messages by workers. Let's say certain worker pulls the message but unable to process it. The unacknowledged message goes back to queue and will be pulled by another worker. This loop can continue indefinitely unless the 7 days limit of max message age is reached.

    It would be great to being able to set max retry count which will move the message to dead-messages-queue topic after exhausting the retry limit for the message.

    59 votes
    Vote
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)
      You have left! (?) (thinking…)
      0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
    • Better options for securing subscription push endpoints

      Better options for securing subscription push endpoints

      28 votes
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)
        You have left! (?) (thinking…)
        under review  ·  2 comments  ·  Flag idea as inappropriate…  ·  Admin →
      • Provide a local emulator

        Provide a local emulator

        23 votes
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)
          You have left! (?) (thinking…)
          under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
        • Instance Group auto-scaling based on Cloud Pub/Sub queue count

          It would be great to have an auto-scaling metric for GCE Instance Groups (or k8s 'Jobs') based on a Cloud Pub/Sub's topic count. For asynchronous workloads, as tasks are written into the topic (queue), spin up/down workers from an instance group's template. Additionaly, as Cloud Functions become fully supported, more events will are hoping to move more workloads into a dynamicly scalling into Cloud Pub/Sub - Instance Group workflow.

          14 votes
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)
            You have left! (?) (thinking…)
            1 comment  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
          • Integration with GCS Object Change Notifications

            Integration with GCS Object Change Notifications

            10 votes
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)
              You have left! (?) (thinking…)
              2 comments  ·  Flag idea as inappropriate…  ·  Admin →
            • Remove topic limit

              10,000 topics isn't enough. I need something like 10,000 million.

              8 votes
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)
                You have left! (?) (thinking…)
                0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
              • Subscribe to topic attributes

                Subscribe to topic attributes

                8 votes
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)
                  You have left! (?) (thinking…)
                  under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                • 6 votes
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                  • Configurable expiration time for topic and subscription

                    Configurable expiration time for topic and subscription

                    6 votes
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                      under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                    • undelivered messages Retains period too low.

                      clients cam have vacations up to 6 weeks sometimes. having 7 day retention for those messages too low.

                      5 votes
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)
                        You have left! (?) (thinking…)
                        0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                      • 3 votes
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                          0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
                        • Allow Chained Subscriptions e.g. User -> Team -> Data

                          Allow Chained Subscriptions e.g. User -> Team -> Data

                          3 votes
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                            under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                          • Cloud Monitoring num_undelivered_messages metrics are not accurate

                            Cloud Monitoring num_undelivered_messages metrics are not accurate

                            3 votes
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                              under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                            • Add asyc messages on standard env

                              Using the standard environment with automatic scaling (no background threads) there are no or very small chances to buffer messages and send them to pub/sub in a batch rather than one by one (e.g triggered by a client request).

                              I would like to see it possible to buffer messages and have the pub sub lib send them either when the buffer is full or after a certain time interval has been reached.

                              This would be a very nice performance boost.

                              3 votes
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                                0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
                              • Unable to create subscription with a push end point on App Script (script.google.com)

                                Unable to create subscription with a push end point on App Script (script.google.com)

                                2 votes
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                  under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                • Generating wrong Uri for PubSub Service

                                  Generating wrong Uri for PubSub Service

                                  2 votes
                                  Vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service
                                    Signed in as (Sign out)
                                    You have left! (?) (thinking…)
                                    under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                  • X-Pubsub-Topic

                                    Today a pubsub user has to implement authorization check in a message push handler, so that an adversary cannot push fake messages. The user also has to sign messages. This could be simpler for push handlers hosted on GCP.

                                    Feature request:
                                    - in PubSub, include a special header with the topic name when sending push notifications., e.g. "X-Google-Pubsub-Topic: <full topic name>"
                                    - in AppEngine, clear the header unless it is sent by Google PubSub

                                    The approach is consistent with other special headers, e.g. X-AppEngine-QueueName.

                                    Please also consider headers for subscription name, retry count, etc. Taskqueue's headers can be used as…

                                    1 vote
                                    Vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service
                                      Signed in as (Sign out)
                                      You have left! (?) (thinking…)
                                      1 comment  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                                    • 1 vote
                                      Vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service
                                        Signed in as (Sign out)
                                        You have left! (?) (thinking…)
                                        0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                                      • Provide an example of how to work with push subscriptions locally using the emulator

                                        When working locally I can't seem to get around the https restrictions, IMO a self signed certificate on https://localhost:port/pushendpoint should be sufficient when working locally.

                                        1 vote
                                        Vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service
                                          Signed in as (Sign out)
                                          You have left! (?) (thinking…)
                                          0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                                        • Don't see your idea?

                                        Cloud Pub/Sub

                                        Feedback and Knowledge Base