Cloud Pub/Sub

Welcome to the Google Cloud Pub/Sub idea forum. You can submit and vote on ideas here to tell the Pub/Sub team which features you’d like to see.

This forum is for feature suggestions. If you’re looking for help forums, look here:

We can’t wait to hear from you!

How can we improve Cloud Pub/Sub?

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. Add Retry Count to Pub/Sub

    The way we plan to work with Pub/Sub is by pulling messages by workers. Let's say certain worker pulls the message but unable to process it. The unacknowledged message goes back to queue and will be pulled by another worker. This loop can continue indefinitely unless the 7 days limit of max message age is reached.

    It would be great to being able to set max retry count which will move the message to dead-messages-queue topic after exhausting the retry limit for the message.

    103 votes
    Vote
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      Signed in as (Sign out)
      You have left! (?) (thinking…)
      3 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
    • Better options for securing subscription push endpoints

      Better options for securing subscription push endpoints

      36 votes
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        Signed in as (Sign out)
        You have left! (?) (thinking…)
        under review  ·  3 comments  ·  Flag idea as inappropriate…  ·  Admin →
      • Provide a local emulator

        Provide a local emulator

        31 votes
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          Signed in as (Sign out)
          You have left! (?) (thinking…)
          under review  ·  1 comment  ·  Flag idea as inappropriate…  ·  Admin →
        • Instance Group auto-scaling based on Cloud Pub/Sub queue count

          It would be great to have an auto-scaling metric for GCE Instance Groups (or k8s 'Jobs') based on a Cloud Pub/Sub's topic count. For asynchronous workloads, as tasks are written into the topic (queue), spin up/down workers from an instance group's template. Additionaly, as Cloud Functions become fully supported, more events will are hoping to move more workloads into a dynamicly scalling into Cloud Pub/Sub - Instance Group workflow.

          22 votes
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            Signed in as (Sign out)
            You have left! (?) (thinking…)
            2 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
          • Remove topic limit

            10,000 topics isn't enough. I need something like 10,000 million.

            15 votes
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              Signed in as (Sign out)
              You have left! (?) (thinking…)
              0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
            • Subscribe to topic attributes

              Subscribe to topic attributes

              11 votes
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                Signed in as (Sign out)
                You have left! (?) (thinking…)
                under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
              • Allow specific metadata for notifications from Google Cloud Storage

                When GCS is registered as a publisher to a topic, we can specify *none* as the payload if all we need are the eventType, bucketId, objectId, and objectGeneration fields. This is great since the message data is only roughly 650 bytes for reasonably size bucket names and file names. For most projects, that's all we need. It's great that objectGeneration happens to be included.

                However, if we need just one other field from the object's metadata, say Content-Length for example, which would add roughly 20 more bytes, we're stuck with the entire basket of metadata fields. We'd like to specify…

                11 votes
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  Signed in as (Sign out)
                  You have left! (?) (thinking…)
                  0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                • Provide an example of how to work with push subscriptions locally using the emulator

                  When working locally I can't seem to get around the https restrictions, IMO a self signed certificate on https://localhost:port/pushendpoint should be sufficient when working locally.

                  11 votes
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                  • 10 votes
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                      0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                    • Integration with GCS Object Change Notifications

                      Integration with GCS Object Change Notifications

                      10 votes
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        Signed in as (Sign out)
                        You have left! (?) (thinking…)
                        2 comments  ·  Flag idea as inappropriate…  ·  Admin →
                      • Configurable expiration time for topic and subscription

                        Configurable expiration time for topic and subscription

                        7 votes
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                          under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                        • undelivered messages Retains period too low.

                          clients cam have vacations up to 6 weeks sometimes. having 7 day retention for those messages too low.

                          6 votes
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                            0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                          • ability to see (read/delete) messages in the console

                            It would be great for testing and troubleshooting.

                            5 votes
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                              1 comment  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                            • 5 votes
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                                0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                              • Emulator should not need content-type header, or provide proper error response

                                The real PubSub API request a publish request (potentially others) without the content-type header.

                                The PubSub Emulator returns a 404 error if no content-type header is set, or a wrong content-type header is set.

                                404 is the wrong HTTP status code in such a situation (400 is correct), and without a proper error message, this is extremely difficult to debug. I wasted a lot of time debugging whether I set up the topic correctly, and whether I constructed the URL correctly.

                                Please either ignore the content-type header (like the PubSub API does), or provide a 400 response with a proper…

                                4 votes
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                  0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
                                • Subscriber Message Filtering

                                  It should be possible for a subscriber to assign a "filter policy" to the topic subscription. E.g. by looking at some header attribute it should be possible to only get a subset of messages.

                                  4 votes
                                  Vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    Signed in as (Sign out)
                                    You have left! (?) (thinking…)
                                    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                                  • Add publisher IP to PubsubMessage

                                    For improved auditing and security it would be nice if a field were added that specifies the originating IP address of the message.

                                    3 votes
                                    Vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      Signed in as (Sign out)
                                      You have left! (?) (thinking…)
                                      0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
                                    • 3 votes
                                      Vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        Signed in as (Sign out)
                                        You have left! (?) (thinking…)
                                        0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
                                      • Allow Chained Subscriptions e.g. User -> Team -> Data

                                        Allow Chained Subscriptions e.g. User -> Team -> Data

                                        3 votes
                                        Vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          Signed in as (Sign out)
                                          You have left! (?) (thinking…)
                                          under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                        • Cloud Monitoring num_undelivered_messages metrics are not accurate

                                          Cloud Monitoring num_undelivered_messages metrics are not accurate

                                          3 votes
                                          Vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            Signed in as (Sign out)
                                            You have left! (?) (thinking…)
                                            under review  ·  0 comments  ·  Flag idea as inappropriate…  ·  Admin →
                                          ← Previous 1
                                          • Don't see your idea?

                                          Cloud Pub/Sub

                                          Feedback and Knowledge Base