Tried to point a side-input to a BigQuery view, instead of directly to a BigQuery table. It does not produce an error, but simply returns 0 rows. View works fine inside BigQuery.
For example, given a view referencing a table 'types_test' with just 1 row:

In BigQuery, it works fine:

But using the view as a side-input in Dataflow return 0 rows:
INFO: Reading from BigQuery table <removed>:CPT_7414_PLAYGROUND.view_test
Mar 20, 2015 11:10:08 PM com.google.cloud.dataflow.sdk.io.BigQueryIO evaluateReadHelper
INFO: Number of records read from BigQuery: 0
Do side-inputs support views in BigQuery, or do you need to do something else to use a view for a side-input?
Found in the FAQ's, that views are not currently supported.
https://cloud.google.com/dataflow/faq#question-13
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With