Problem Note 63777: SAS® Viya® incorrectly stores Impala tables as text rather than using the specified Parquet format
SAS® Data Connector to Impala for SAS Viya incorrectly stores tables as text rather than using the Parquet compression. Sample code that should be stored using the Parquet compression is shown here:
caslib prqt datasource=(
srctype = 'impala'
server = 'myserver.com'
port = #####
impala_dsn = 'your-dsn'
schema = 'your-schema'
dbCreateTableOpts = 'stored as parquet'
);
proc cas;
save caslib="prqt"
name="TESTE_PARQUET_1"
table={caslib="CASUSER", name="your-table"}
replace=true
options={dbCreateTableOpts="stored as parquet"};
quit;
When you run this code, it is incorrectly stored as text.
Click the Hot Fix tab in this note for a link to instructions about accessing and applying the software update.
Operating System and Release Information
SAS System | SAS Data Connector to Impala | Linux for x64 | Viya | |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
When you use the SAS® Data Connector to Impala and you specify 'stored as Parquet' for the DBCREATETABLEOPTS option, SAS Viya incorrectly stores the data as text.
Type: | Problem Note |
Priority: | high |
Date Modified: | 2019-03-01 16:35:23 |
Date Created: | 2019-03-01 08:39:45 |