Problem Note 71025: Querying a Google BigQuery view that requires a WHERE clause might result in an error due to the WHERE clause not being included in the query
Trying to query a Google BigQuery table or view might result in an error or slower performance when the following are true:
- You are referencing a partitioned table directly, or—if referencing a view—the view is based on a partitioned table.
- You are using a DATA step or one of the Base SAS® procedures that are enabled for in-database processing.
- You are running SAS® 9.4M8 (TS1M8) with Hot Fix M7X003 or later.
If the table or the underlying table that the view is based on requires a WHERE clause, the following error occurs:
ERROR: CLI prepare error: Error occurred during Post Optimization. : Error: googleapi: Error 400: Cannot query over table 'project.dataset.table' without a filter over column(s) 'xxx' that can be used for partition elimination, invalidQuery
If a WHERE clause was not required, the step proceeds, but the performance will be slower as the entire table is read and the WHERE clause is processed by SAS.
There is no workaround for this issue.
Click the Hot Fix tab in this note to access the hot fix for this issue.
See SAS Note 68636 and SAS Note 68634 for similar issues.
Operating System and Release Information
SAS System | SAS/ACCESS Interface to Google BigQuery | Linux for x64 | 9.4 | | 9.4 TS1M6 | |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Type: | Problem Note |
Priority: | high |
Date Modified: | 2024-11-12 16:18:23 |
Date Created: | 2024-10-30 15:52:19 |