Cloud Pub/Sub

Welcome to the Google Cloud Pub/Sub idea forum. You can submit and vote on ideas here to tell the Pub/Sub team which features you’d like to see.

This forum is for feature suggestions. If you’re looking for help forums, look here:

We can’t wait to hear from you!

  1. Replace returnImmediately with a timeout

    In its current form, projects.subscriptions.pull accepts the following parameters in its request payload: returnImmediately and maxMessages. The former parameter restricts the library authors (including the official GCP driver) into one of two extremes:

    1. Either poll the endpoint periodically (e.g., every 10s) via returnImmediately=true.

    2. Or poll indefinitely via returnImmediately=false.

    The first approach ensures a deterministic message stream with the cost of degraded latency. The second approach does the opposite: a nondeterministic stream with better latency. I think there is a better alternative: introducing a timeout parameter. This will act as knob one can tune to move between these…

    42 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  2. Demasiada información y muy difícil de encontrar lo que uno busca

    Es muy difícil encontrar lo que uno busca, demasiada información y muchas horas perdidas para finalmente no encontrar lo que mi proyecto necesita. Simplemente queremos cada vez que un email llegue a la cuenta nuestra de gmail, se envié un payload con dicha información a un endpoint en nuestro server. He probado a configurar el push con el endpoint (siguiendo el ejemplo de la página de ayuda, pero en vez de pull seleccionado push), pero el mensaje nunca llega a nuestro servidor.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  3. Screenshots and Self driven flash based / gif - much helpful for

    Documentation should have screenshots and adobe flash based / gifs which can give visualization to anyone who would like to try / explore.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  4. How to use the pubsub emulator in multiple languages

    There is one brief example in python. Could other examples be created - like node?

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  5. 1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
  6. Emulator fails when google-cloud-sdk path includes a space

    Launching the PubSub emulator on my workstation running MacOS 10.15.5 errors out immediately. Fortunately the error message is informative:

    $ gcloud beta emulators pubsub --verbosity debug start
    DEBUG: Running [gcloud.beta.emulators.pubsub.start] with arguments: [--verbosity: "debug"]
    DEBUG: Found Cloud SDK root: /Users/lex/Library/Application Support/google-cloud-tools-java/managed-cloud-sdk/LATEST/google-cloud-sdk
    Executing: /Users/lex/Library/Application Support/google-cloud-tools-java/managed-cloud-sdk/LATEST/google-cloud-sdk/platform/pubsub-emulator/bin/cloud-pubsub-emulator --host=localhost --port=8085
    [pubsub] Error: Unable to access jarfile /Users/lex/Library/Application

    Specifically, "Unable to access jarfile" message cuts off the path that it had correctly found (according to the previous line) right where the path includes a space. I haven't dug into the source, but it looks like the detected path has not been correctly escaped to handle…

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
  7. Need easy to understand content

    I come from mechanical engineering background so want more easier to understand content

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  8. Better description of the diagram describing the tasks clear and logically, incomes and outcomes for each of them. More relevant examples

    Start examples with generic steps to have a better understanding of the tool then provide more relevant examples (beyond Hello world!) through the steps instead just basing examples on do this and now this and after that because I found gaps and errors in multiple cases already

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
  9. Enable API key authentication for publisher

    I have a use case where events are published to a pub/sub topic from the client side. As it is client side I cannot authenticate via the methods supported currently for publishing messages. As quite tight restrictions can be placed on what domain is attempting to publish it would be great to open up the possibility of authenticating via an API key

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  10. delayed / scheduled messages

    When publishing a message, accept a DateTime (in the future) which defines when the message will be scheduled. This way a function can be executed in e.g. 30 minutes (with the message content as an input argument).

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  11. 1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
  12. Please add a working example of how to update the expiration_policy of an existing subscription for pubsub library in python

    Similar to the example of pushconfig with updatemask, please provide something similar for expiration_policy to set it to 'never' as to make the subscription permanent once it was created

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  13. Delete particular message based on message Id

    As few time processing of the message can take a lot of time, it would be great if the message can be deleted based on messageId.

    The ackId changes and therefore after the acknowledgment dead line is passed hitting the ack api with the ackId does not help.

    This feature can be used to ack message whenever a consumer wants in a distributed consumer environment.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  14. Emulator needs to increase max gRPC message size to match production

    The emulator drops connections when publish messages exceed 4 MiB. However, the production pubsub service enforces a max publish message size limit of 10000000 bytes. It returns a friendly error code when you exceed that limit (at least up to some max; I haven't really tried). The two should match.

    The server needs to call maxInboundMessageSize() when it is being configured:

    https://grpc.github.io/grpc-java/javadoc/io/grpc/ServerBuilder.html#maxInboundMessageSize-int-

    The exception logged in the emulator is the following:

    [pubsub] WARNING: Exception processing message
    [pubsub] io.grpc.StatusRuntimeException: RESOURCE_EXHAUSTED: gRPC message exceeds maximum size 4194304: 9000111
    [pubsub] at io.grpc.Status.asRuntimeException(Status.java:523)
    [pubsub] at io.grpc.internal.MessageDeframer.processHeader(MessageDeframer.java:387)
    [pubsub] at io.grpc.internal.MessageDeframer.deliver(MessageDeframer.java:267)
    [pubsub] at io.grpc.internal.MessageDeframer.request(MessageDeframer.java:161)
    [pubsub] at…

    10 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
  15. 2 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
  16. No esta traducida al español.

    No esta traducida al español.

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
  17. Subscriber Message Filtering

    It should be possible for a subscriber to assign a "filter policy" to the topic subscription. E.g. by looking at some header attribute it should be possible to only get a subset of messages.

    665 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    16 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  18. lenguaje

    No se cambia el idioma al seleccionar Español

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
  19. Align pubsub and emulator message when topic not found

    When publishing to a topic that does not exist emulator and real pubsub return different message.
    Emulator:
    NOTFOUND: Topic not found
    Real PubSub:
    NOT
    FOUND: Resource not found

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Defect  ·  Flag idea as inappropriate…  ·  Admin →
  20. 1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Cloud Pub/Sub

Categories

Feedback and Knowledge Base