Problem Note 63990: SAS® In-Database Code Accelerator for Hadoop fails with errors when you try to access an Apache Hive table that is stored on Amazon S3
To use SAS In-Database Code Accelerator for Hadoop with Hive table data on S3 and the SAS® Embedded Process on an Amazon Web Services cluster, you might submit code that is similar to the following:
option set = SAS_HADOOP_JAR_PATH = "C:\TESTIT\jars";
option set = SAS_HADOOP_CONFIG_PATH = "C:\TESTIT\sitexmls";
options sastrace=',,,d' sastraceloc=saslog nostsuffix
sql_ip_trace=(note,source)
msglevel=i;
libname emr hadoop server="ip-xxx.yyy.internal" user="user2"
hdfs_tempdir="/user/user2/tmp";
proc ds2 ds2accel=yes;
thread indb_thread1;
/* declare global variables, included in output if not dropped */
method run();
set emr.cars; /* declare local variables, not included in output */
by make;
if last.make then
output;
end;
endthread;
run;
ds2_options trace;
data emr.output_table;
dcl thread indb_thread1 indb1; /* instance of the thread */
method run();
set from indb1;
output;
end;
enddata;
run;
quit;
In the code example, emr.cars is located in an S3 path.
After the code runs, you might encounter errors similar to the following:
ERROR: java.lang.IllegalArgumentException: Wrong FS:
s3a://sas-xxx/dir/cars,expected: hdfs://ip-xxx.yyy.internal:8020
ERROR: Failed to run DS2INDB.
ERROR: Error returned from tkedsPubINDBDS2.
Click the Hot Fix tab in this note for a link to instructions about accessing and applying the software update.
Operating System and Release Information
SAS System | SAS In-Database Code Accelerator for Hadoop | Microsoft Windows 8 Pro 32-bit | | 9.4 TS1M6 |
Microsoft Windows 8 Pro x64 | | 9.4 TS1M6 |
Microsoft Windows 8.1 Enterprise 32-bit | | 9.4 TS1M6 |
Microsoft Windows 8.1 Enterprise x64 | | 9.4 TS1M6 |
Microsoft Windows 8.1 Pro 32-bit | | 9.4 TS1M6 |
Microsoft Windows 8.1 Pro x64 | | 9.4 TS1M6 |
Microsoft Windows 10 | | 9.4 TS1M6 |
Microsoft Windows 95/98 | | |
Microsoft Windows 2000 Advanced Server | | |
Microsoft Windows 2000 Datacenter Server | | |
Microsoft Windows 2000 Server | | |
Microsoft Windows 2000 Professional | | |
Microsoft Windows NT Workstation | | |
Microsoft Windows Server 2003 Datacenter Edition | | |
Microsoft Windows Server 2003 Enterprise Edition | | |
Microsoft Windows Server 2003 Standard Edition | | |
Microsoft Windows Server 2003 for x64 | | |
Microsoft Windows Server 2008 | | |
Microsoft Windows Server 2008 R2 | | |
Microsoft Windows Server 2008 for x64 | | |
Microsoft Windows Server 2012 Datacenter | | 9.4 TS1M6 |
Microsoft Windows Server 2012 R2 Datacenter | | 9.4 TS1M6 |
Microsoft Windows Server 2012 R2 Std | | 9.4 TS1M6 |
Microsoft Windows Server 2012 Std | | 9.4 TS1M6 |
Microsoft Windows Server 2016 | | 9.4 TS1M6 |
Microsoft Windows Server 2019 | | 9.4 TS1M6 |
Microsoft Windows XP Professional | | |
Windows 7 Enterprise 32 bit | | 9.4 TS1M6 |
Windows 7 Enterprise x64 | | 9.4 TS1M6 |
Windows 7 Home Premium 32 bit | | 9.4 TS1M6 |
Microsoft Windows 8 Enterprise x64 | | 9.4 TS1M6 |
Microsoft Windows 8 Enterprise 32-bit | | 9.4 TS1M6 |
Microsoft® Windows® for x64 | | 9.4 TS1M6 |
Windows 7 Home Premium x64 | | 9.4 TS1M6 |
Windows 7 Professional 32 bit | | 9.4 TS1M6 |
Windows 7 Professional x64 | | 9.4 TS1M6 |
Windows 7 Ultimate 32 bit | | 9.4 TS1M6 |
Windows 7 Ultimate x64 | | 9.4 TS1M6 |
Windows Millennium Edition (Me) | | |
Windows Vista | | |
Windows Vista for x64 | | |
64-bit Enabled AIX | | 9.4 TS1M6 |
64-bit Enabled Solaris | | 9.4 TS1M6 |
HP-UX IPF | | 9.4 TS1M6 |
Linux for x64 | | 9.4 TS1M6 |
Solaris for x64 | | 9.4 TS1M6 |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Type: | Problem Note |
Priority: | high |
Date Modified: | 2019-04-12 13:14:36 |
Date Created: | 2019-04-05 12:24:58 |