Problem Note 66990: Data might not be loaded into a Google BigQuery table when you specify BULKLOAD=yes
When you use the LIBNAME or data set option BULKLOAD=YES to load rows into a Google BigQuery table, the data might not be inserted. In this scenario, the log indicates that the data was inserted and no error is given. Due to the timing of processes, BigQuery errors related to the loading of the data might not be received by SAS. Because of these timing issues, SAS might report that the load was successful when there was an issue.
One possible cause of this issue is if a delimiter chosen using the BL_DELIMITER= option for the BULKLOAD also appears in the data, as shown below:
data bq.test(bulkload=yes BL_DELIMITER=',');
col1 = 'test, this 1';
run;
For this particular case, the only workarounds are to specify a delimiter that is not found in the data or to not use BULKLOAD when trying to load data into a BigQuery table. In general, there is no workaround for this issue.
Operating System and Release Information
SAS System | SAS/ACCESS Interface to Google BigQuery | Linux for x64 | 9.4 | | 9.4 TS1M6 | |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Type: | Problem Note |
Priority: | high |
Date Modified: | 2021-10-05 09:20:10 |
Date Created: | 2020-11-23 10:27:58 |