Problem Note 68636: Trying to query a Google BigQuery partitioned table that requires a WHERE clause might generate an error
Trying to query a BigQuery table might generate an error when the following is true:
- The table is an ingestion-time partitioned table.
- The table is defined to require a partitioning WHERE clause.
- The LIBNAME statement includes the READ_MODE=STORAGE option.
When the query includes the required partitioning WHERE clause, an error similar to the following occurs because the variables '_PARTITION_LOAD_TIME', '_PARTITIONDATE', and '_PARTITIONTIME' are not actual variables in the table:
ERROR: The following columns were not found in the contributing tables: _PARTITIONTIME.
Trying to query a Google BigQuery table without the required partitioning WHERE clause generates an expected error that might look similar to the following:
ERROR: During read: rpc error: code = InvalidArgument desc = request failed: Cannot query over table 'project.dataset.table' without a filter over column(s) 'variable' that can be used for partition elimination
Trying to query a BigQuery table without the required partitioning WHERE clause and without the READ_MODE=STORAGE option incorrectly allows the query to execute, even though the table was defined as requiring a WHERE clause.
Click the Hot Fix tab in this note to access the hot fix for this issue.
Operating System and Release Information
SAS System | SAS/ACCESS Interface to Google BigQuery | Linux for x64 | 9.4 | | 9.4 TS1M6 | |
SAS System | SAS/ACCESS Interface to Google BigQuery (on SAS Viya) | Linux for x64 | V.03.04 | Stable 2023.04 | | Viya platform |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Type: | Problem Note |
Priority: | high |
Date Modified: | 2024-08-23 13:24:10 |
Date Created: | 2021-11-23 09:56:17 |