Bug: Dataflow jobs are not shown consistently on cloud console
Currently running jobs are sometimes not shown on cloud console. After refreshing the page, they sometimes show up, just to disappear again a couple of seconds later.
The behaviour is very inconsistent and therefore I have not found a way to replicate the issue. It seems mostly time dependent. A couple of weeks ago I noticed this issue for the first time. Today, I've been suffering from the issue the whole day, while yesterday everything was working fine.
Dmitri Lihhatsov commented
Same highly annoying issue here, with Dataflow jobs in europe-west1-c region. Batch jobs both Python and Java. Streaming Java jobs are performing slightly better, i.e. with a less lag.
Karel Dumon commented
I have exactly the same issue.
There were some listjobs server OOM crashes which caused a delay to dashboard updates, but now the issue has been resolved.
Ralf Hein commented
I see the same behaviour. Also, calling the job status directly (via the link provided by the cli tool) will lead to a "job id does not exist" error, while in reality the job is running fine.