How can I change bucket or prefix when writing to Google Cloud Storage from Dataflow? -


in streaming dataflow pipeline, how can dynamically change bucket or prefix of data write cloud storage?

for example, store data text or avro files on gcs, prefix includes processing hour.

update: question invalid because there no sink can use in streaming dataflow writes google cloud storage.

google cloud dataflow not allow gcs sinks in streaming mode.


Comments