SUPPORT / SAMPLES & SAS NOTES
 

Support

Problem Note 63990: SAS® In-Database Code Accelerator for Hadoop fails with errors when you try to access an Apache Hive table that is stored on Amazon S3

DetailsHotfixAboutRate It

To use SAS In-Database Code Accelerator for Hadoop with Hive table data on S3 and the SAS® Embedded Process on an Amazon Web Services cluster, you might submit code that is similar to the following:

option set = SAS_HADOOP_JAR_PATH = "C:\TESTIT\jars";
option set = SAS_HADOOP_CONFIG_PATH = "C:\TESTIT\sitexmls";

options sastrace=',,,d' sastraceloc=saslog nostsuffix
sql_ip_trace=(note,source)
msglevel=i;

libname emr hadoop server="ip-xxx.yyy.internal" user="user2"
   hdfs_tempdir="/user/user2/tmp";

proc ds2 ds2accel=yes;
thread indb_thread1;
/* declare global variables, included in output if not dropped */

   method run();
      set emr.cars;   /* declare local variables, not included in output */
         by make;
            if last.make then
            output;
   end;
endthread;
run;

ds2_options trace;
data emr.output_table;
dcl thread indb_thread1 indb1; /* instance of the thread */
   method run();
      set from indb1;
      output;
   end;
enddata;
run;
quit;

In the code example, emr.cars is located in an S3 path.

After the code runs, you might encounter errors similar to the following:

ERROR: java.lang.IllegalArgumentException:  Wrong FS:
s3a://sas-xxx/dir/cars,expected: hdfs://ip-xxx.yyy.internal:8020
ERROR:  Failed to run DS2INDB.
ERROR:  Error returned from tkedsPubINDBDS2.

Click the Hot Fix tab in this note for a link to instructions about accessing and applying the software update.



Operating System and Release Information

Product FamilyProductSystemSAS Release
ReportedFixed*
SAS SystemSAS In-Database Code Accelerator for HadoopMicrosoft Windows 8 Pro 32-bit9.4 TS1M6
Microsoft Windows 8 Pro x649.4 TS1M6
Microsoft Windows 8.1 Enterprise 32-bit9.4 TS1M6
Microsoft Windows 8.1 Enterprise x649.4 TS1M6
Microsoft Windows 8.1 Pro 32-bit9.4 TS1M6
Microsoft Windows 8.1 Pro x649.4 TS1M6
Microsoft Windows 109.4 TS1M6
Microsoft Windows 95/98
Microsoft Windows 2000 Advanced Server
Microsoft Windows 2000 Datacenter Server
Microsoft Windows 2000 Server
Microsoft Windows 2000 Professional
Microsoft Windows NT Workstation
Microsoft Windows Server 2003 Datacenter Edition
Microsoft Windows Server 2003 Enterprise Edition
Microsoft Windows Server 2003 Standard Edition
Microsoft Windows Server 2003 for x64
Microsoft Windows Server 2008
Microsoft Windows Server 2008 R2
Microsoft Windows Server 2008 for x64
Microsoft Windows Server 2012 Datacenter9.4 TS1M6
Microsoft Windows Server 2012 R2 Datacenter9.4 TS1M6
Microsoft Windows Server 2012 R2 Std9.4 TS1M6
Microsoft Windows Server 2012 Std9.4 TS1M6
Microsoft Windows Server 20169.4 TS1M6
Microsoft Windows Server 20199.4 TS1M6
Microsoft Windows XP Professional
Windows 7 Enterprise 32 bit9.4 TS1M6
Windows 7 Enterprise x649.4 TS1M6
Windows 7 Home Premium 32 bit9.4 TS1M6
Microsoft Windows 8 Enterprise x649.4 TS1M6
Microsoft Windows 8 Enterprise 32-bit9.4 TS1M6
Microsoft® Windows® for x649.4 TS1M6
Windows 7 Home Premium x649.4 TS1M6
Windows 7 Professional 32 bit9.4 TS1M6
Windows 7 Professional x649.4 TS1M6
Windows 7 Ultimate 32 bit9.4 TS1M6
Windows 7 Ultimate x649.4 TS1M6
Windows Millennium Edition (Me)
Windows Vista
Windows Vista for x64
64-bit Enabled AIX9.4 TS1M6
64-bit Enabled Solaris9.4 TS1M6
HP-UX IPF9.4 TS1M6
Linux for x649.4 TS1M6
Solaris for x649.4 TS1M6
* For software releases that are not yet generally available, the Fixed Release is the software release in which the problem is planned to be fixed.