Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Do 'side inputs' in Cloud Dataflow support reading from BigQuery views?

Tried to point a side-input to a BigQuery view, instead of directly to a BigQuery table. It does not produce an error, but simply returns 0 rows. View works fine inside BigQuery.

For example, given a view referencing a table 'types_test' with just 1 row:

enter image description here

In BigQuery, it works fine:

enter image description here

But using the view as a side-input in Dataflow return 0 rows:

INFO: Reading from BigQuery table <removed>:CPT_7414_PLAYGROUND.view_test
Mar 20, 2015 11:10:08 PM com.google.cloud.dataflow.sdk.io.BigQueryIO evaluateReadHelper
INFO: Number of records read from BigQuery: 0

Do side-inputs support views in BigQuery, or do you need to do something else to use a view for a side-input?

like image 910
Graham Polley Avatar asked Dec 03 '25 12:12

Graham Polley


1 Answers

Found in the FAQ's, that views are not currently supported.

https://cloud.google.com/dataflow/faq#question-13

like image 170
Graham Polley Avatar answered Dec 06 '25 05:12

Graham Polley



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!