Problem Note 65175: Installing the Hive SerDe for SPD Engine with the sashiveserdespde-installjar.sh script fails with a java.lang.ClassCastException
 |  |  |  |  |
When you install the SAS® Scalable Performance Data (SPD) Engine SerDe for Apache Hive with the sashiveserdespde-installjar.sh script, the installation might fail. An error that is similar to the following occurs:
Exception in thread "main" java.lang.ClassCastException:
org.apache.hadoop.fs.adl.HdiAdlFileSystem cannot be cast to
org.apache.hadoop.hdfs.DistributedFileSystem
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil$1.run(AdminUtil.java:52)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil$1.run(AdminUtil.java:49)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1
869)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil.getLiveDataNodes(AdminUtil.ja
va:48)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil.listDataNodes(AdminUtil.java:
78)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil.run(AdminUtil.java:126)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil.main(AdminUtil.java:155)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:243)
at org.apache.hadoop.util.RunJar.main(RunJar.java:158)
org.apache.hadoop.fs.adl.HdiAdlFileSystem cannot be cast to
org.apache.hadoop.hdfs.DistributedFileSystem
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil$1.run(AdminUtil.java:52)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil$1.run(AdminUtil.java:49)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1
869)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil.getLiveDataNodes(AdminUtil.ja
va:48)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil.listDataNodes(AdminUtil.java:
78)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil.run(AdminUtil.java:126)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at
com.sas.hadoop.serde.spde.hive.utilities.AdminUtil.main(AdminUtil.java:155)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:243)
at org.apache.hadoop.util.RunJar.main(RunJar.java:158)
Click the Hot Fix tab in this note to access the hot fix for this issue.
Operating System and Release Information
| Product Family | Product | System | Product Release | SAS Release | ||
| Reported | Fixed* | Reported | Fixed* | |||
| SAS System | Base SAS | z/OS | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 |
| z/OS 64-bit | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft® Windows® for x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows 8 Enterprise 32-bit | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows 8 Enterprise x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows 8 Pro 32-bit | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows 8 Pro x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows 8.1 Enterprise 32-bit | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows 8.1 Enterprise x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows 8.1 Pro 32-bit | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows 8.1 Pro x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows 10 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows Server 2012 Datacenter | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows Server 2012 R2 Datacenter | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows Server 2012 R2 Std | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows Server 2012 Std | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows Server 2016 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Microsoft Windows Server 2019 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Windows 7 Enterprise 32 bit | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Windows 7 Enterprise x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Windows 7 Home Premium 32 bit | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Windows 7 Home Premium x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Windows 7 Professional 32 bit | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Windows 7 Professional x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Windows 7 Ultimate 32 bit | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Windows 7 Ultimate x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| 64-bit Enabled AIX | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| 64-bit Enabled Solaris | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| HP-UX IPF | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Linux for x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
| Solaris for x64 | 9.4_M6 | 9.4_M6 | 9.4 TS1M6 | 9.4 TS1M6 | ||
A fix for this issue for SAS Hive SerDe for SPDE Data 9.43 is available at:
https://tshf.sas.com/techsup/download/hotfix/HF2/G4G.html#65175| Type: | Problem Note |
| Priority: | high |
| Date Modified: | 2020-01-21 12:27:21 |
| Date Created: | 2019-11-26 14:59:02 |