Problem Note 54544: Poor performance occurs with implicit Hive joins that contain a WHERE clause
 |  |  |  |  |
In Hive .12 and earlier, implicit joins that contain a WHERE clause are very poorly optimized. This can cause the query to consume large amounts of memory and fail to complete. Here is an example of an implicit join that would likely to result in this issue:
create table myhadoop.join3a as
select t1.i,
t1.test,
t2.value,
t3.name
from myhadoop.test2 t1, myhadoop.test1 t2, myhadoop.test3 t3
where (t1.i = t2.i AND t1.i = t3.i);
Changing the WHERE clause to an ON clause enables the query to run normally. This problem has been fixed in Hive .13 and later.
Operating System and Release Information
| Product Family | Product | System | Product Release | SAS Release | ||
| Reported | Fixed* | Reported | Fixed* | |||
| SAS System | SAS/ACCESS Interface to Hadoop | Microsoft® Windows® for x64 | 9.4_M2 | 9.4 TS1M2 | ||
| Microsoft Windows 8 Enterprise 32-bit | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows 8 Enterprise x64 | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows 8 Pro 32-bit | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows 8 Pro x64 | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows 8.1 Enterprise 32-bit | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows 8.1 Enterprise x64 | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows 8.1 Pro | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows 8.1 Pro 32-bit | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows Server 2008 | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows Server 2008 R2 | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows Server 2008 for x64 | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows Server 2012 Datacenter | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows Server 2012 R2 Datacenter | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows Server 2012 R2 Std | 9.4_M2 | 9.4 TS1M2 | ||||
| Microsoft Windows Server 2012 Std | 9.4_M2 | 9.4 TS1M2 | ||||
| Windows 7 Enterprise 32 bit | 9.4_M2 | 9.4 TS1M2 | ||||
| Windows 7 Enterprise x64 | 9.4_M2 | 9.4 TS1M2 | ||||
| Windows 7 Home Premium 32 bit | 9.4_M2 | 9.4 TS1M2 | ||||
| Windows 7 Home Premium x64 | 9.4_M2 | 9.4 TS1M2 | ||||
| Windows 7 Professional 32 bit | 9.4_M2 | 9.4 TS1M2 | ||||
| Windows 7 Professional x64 | 9.4_M2 | 9.4 TS1M2 | ||||
| Windows 7 Ultimate 32 bit | 9.4_M2 | 9.4 TS1M2 | ||||
| Windows 7 Ultimate x64 | 9.4_M2 | 9.4 TS1M2 | ||||
| 64-bit Enabled AIX | 9.4_M2 | 9.4 TS1M2 | ||||
| 64-bit Enabled Solaris | 9.4_M2 | 9.4 TS1M2 | ||||
| HP-UX IPF | 9.4_M2 | 9.4 TS1M2 | ||||
| Linux for x64 | 9.4_M2 | 9.4 TS1M2 | ||||
| Solaris for x64 | 9.4_M2 | 9.4 TS1M2 | ||||
A fix for this issue for SAS Enterprise Guide 6.1_M1 is available at:
https://tshf.sas.com/techsup/download/hotfix/HF2/M54.html#54544| Type: | Problem Note |
| Priority: | high |
| Date Modified: | 2014-12-04 16:42:20 |
| Date Created: | 2014-11-05 16:49:34 |