Cloud Pub/Sub

Welcome to the Google Cloud Pub/Sub idea forum. You can submit and vote on ideas here to tell the Pub/Sub team which features you’d like to see.

This forum is for feature suggestions. If you’re looking for help forums, look here:

We can’t wait to hear from you!

  1. Add pull subscription response http code as attribute

    We know from https://cloud.google.com/pubsub/docs/push),that when Push-subscriber ie. a REST-service returns http codes 102, 200, 201, 202 or 204, then messages are acknowledged.

    No response (after timeout) or any other http return code will retry sending message.

    It would be really useful, if the service would add/set this http error code (or no response info) in the message as attribute.

    The error analysing would be much easier.

    This could be further used for automatic error recovery. For example, all unsent message could end up in on dead-letter queue and publisher(s) could read this dead letter topi topic and send the messages…

    4 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  2. Intelligent Message Routing

    PubSub Control plane can be more smarter if it can detect which subscriber is closest in proximity and forward the message to that. It can borrow the traits of GLB. If the subscriber is busy replay the message but this time it should go to next nearest subscriber. There are certain trade offs but I think it will be a worth feature. It will reduce the egress cost of data transfer and keeps the data by default closer to the customer. It will also work well with the regional resources behind GLB which wants to generate messages.

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  3. "Migrate" subscriptions

    If you have to update a subscription's settings (like changing a filter), then the subscription needs to be recreated. The risk here is that, in production, there could be messages pending so the developer has to stop the publisher and allow the subscription to clear before deleting it and recreating it, resulting in some down time.

    It would be helpful to have a feature that could "migrate" one subscription to another. So for example, I would create the new/updated subscription and then ask PubSub to move any unprocessed message from the old one to the new one. There would still…

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  4. Dockerized image for emulator

    A docker image for the emulator which doesn’t require the install of the gcloud tools

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  5. Spark Structured Streaming

    Apache Spark is the top framework for Big Data processing, widely adopted and with more contributors. Not being able to use Structured Streaming in Pub/Sub is a mayor limitation.

    9 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  6. Airport Transfer

    AtoB Transfer specializes in a taxi service pickup from and to the airport. A taxi transfer with AtoB is more than just a taxi ride. You are treated like a special guest or a good old friend as our number one priority is total customer satisfaction. We create a unique taxi experience.
    https://atobtransfer.com/

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  7. Provide message publisher over simple socket connection

    I am trying to connect to GCP pubsub from a IBM mainframe. I have a simple socket connection written in C language. I would like to send messages over the socket without the overhead of a HTTP message.

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  8. Pub/Sub message ordering should also support stickiness by key

    Similar to kafka, I expect message ordering key to validate that same subscriber gets all messages tagged by a specific message key.
    If I have to aggregate data by message key, currently I can do it only by a service that cannot be scaled. I would like to be able to scale my service, knowing that messages of the same key will always be received by the same service instance.
    (Tested it by writing messages to a topic, all with the same ordering key. Tried to read from two service instances, using same ordering-enabled subscription. While most of the messages…

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  9. Subscriber Filtering Messages

    Filter messages based on given substring.
    Eg:- has(attributes.KEY, "SUBSTRING")

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  10. hi. Please provide samples and more info about use cases

    I have a python Django app that use Celery for asynchronous task, and rabbitMQ to send emails. I want to migrate my app to GCP, and I want to have the best architecture, more efficient, best performance, best practices. So, I want a direction in what should I use, or replace. Thank you.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  11. Plusen control fuel saving project

    I'm making project plusen contorl fule saving projact on new power generation project is completed your support depends think

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  12. Filter with "IN" clause

    Hi,
    Is it possible to add the ability to filter say an attribute that can have a range of values. Instead of saying where attribute:k1 = "value1" AND attribute:k1 = "value2", can we have something like attribute:k1 IN ("value1", "value2")

    5 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  13. Replace returnImmediately with a timeout

    In its current form, projects.subscriptions.pull accepts the following parameters in its request payload: returnImmediately and maxMessages. The former parameter restricts the library authors (including the official GCP driver) into one of two extremes:

    1. Either poll the endpoint periodically (e.g., every 10s) via returnImmediately=true.

    2. Or poll indefinitely via returnImmediately=false.

    The first approach ensures a deterministic message stream with the cost of degraded latency. The second approach does the opposite: a nondeterministic stream with better latency. I think there is a better alternative: introducing a timeout parameter. This will act as knob one can tune to move between these…

    42 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  14. Demasiada información y muy difícil de encontrar lo que uno busca

    Es muy difícil encontrar lo que uno busca, demasiada información y muchas horas perdidas para finalmente no encontrar lo que mi proyecto necesita. Simplemente queremos cada vez que un email llegue a la cuenta nuestra de gmail, se envié un payload con dicha información a un endpoint en nuestro server. He probado a configurar el push con el endpoint (siguiendo el ejemplo de la página de ayuda, pero en vez de pull seleccionado push), pero el mensaje nunca llega a nuestro servidor.

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  15. Screenshots and Self driven flash based / gif - much helpful for

    Documentation should have screenshots and adobe flash based / gifs which can give visualization to anyone who would like to try / explore.

    6 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  16. How to use the pubsub emulator in multiple languages

    There is one brief example in python. Could other examples be created - like node?

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  17. Need easy to understand content

    I come from mechanical engineering background so want more easier to understand content

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  18. Enable API key authentication for publisher

    I have a use case where events are published to a pub/sub topic from the client side. As it is client side I cannot authenticate via the methods supported currently for publishing messages. As quite tight restrictions can be placed on what domain is attempting to publish it would be great to open up the possibility of authenticating via an API key

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  19. delayed / scheduled messages

    When publishing a message, accept a DateTime (in the future) which defines when the message will be scheduled. This way a function can be executed in e.g. 30 minutes (with the message content as an input argument).

    3 votes
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
  20. Please add a working example of how to update the expiration_policy of an existing subscription for pubsub library in python

    Similar to the example of pushconfig with updatemask, please provide something similar for expiration_policy to set it to 'never' as to make the subscription permanent once it was created

    1 vote
    Vote

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Feature Request  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3
  • Don't see your idea?

Cloud Pub/Sub

Categories

Feedback and Knowledge Base