SUPPORT / SAMPLES & SAS NOTES
 

Support

Problem Note 54544: Poor performance occurs with implicit Hive joins that contain a WHERE clause

DetailsHotfixAboutRate It

In Hive .12 and earlier, implicit joins that contain a WHERE clause are very poorly optimized. This can cause the query to consume large amounts of memory and fail to complete. Here is an example of an implicit join that would likely to result in this issue:

create table myhadoop.join3a as select t1.i, t1.test, t2.value, t3.name from myhadoop.test2 t1, myhadoop.test1 t2, myhadoop.test3 t3 where (t1.i = t2.i AND t1.i = t3.i);

Changing the WHERE clause to an ON clause enables the query to run normally. This problem has been fixed in Hive .13 and later.



Operating System and Release Information

Product FamilyProductSystemProduct ReleaseSAS Release
ReportedFixed*ReportedFixed*
SAS SystemSAS/ACCESS Interface to HadoopMicrosoft® Windows® for x649.4_M29.4 TS1M2
Microsoft Windows 8 Enterprise 32-bit9.4_M29.4 TS1M2
Microsoft Windows 8 Enterprise x649.4_M29.4 TS1M2
Microsoft Windows 8 Pro 32-bit9.4_M29.4 TS1M2
Microsoft Windows 8 Pro x649.4_M29.4 TS1M2
Microsoft Windows 8.1 Enterprise 32-bit9.4_M29.4 TS1M2
Microsoft Windows 8.1 Enterprise x649.4_M29.4 TS1M2
Microsoft Windows 8.1 Pro9.4_M29.4 TS1M2
Microsoft Windows 8.1 Pro 32-bit9.4_M29.4 TS1M2
Microsoft Windows Server 20089.4_M29.4 TS1M2
Microsoft Windows Server 2008 R29.4_M29.4 TS1M2
Microsoft Windows Server 2008 for x649.4_M29.4 TS1M2
Microsoft Windows Server 2012 Datacenter9.4_M29.4 TS1M2
Microsoft Windows Server 2012 R2 Datacenter9.4_M29.4 TS1M2
Microsoft Windows Server 2012 R2 Std9.4_M29.4 TS1M2
Microsoft Windows Server 2012 Std9.4_M29.4 TS1M2
Windows 7 Enterprise 32 bit9.4_M29.4 TS1M2
Windows 7 Enterprise x649.4_M29.4 TS1M2
Windows 7 Home Premium 32 bit9.4_M29.4 TS1M2
Windows 7 Home Premium x649.4_M29.4 TS1M2
Windows 7 Professional 32 bit9.4_M29.4 TS1M2
Windows 7 Professional x649.4_M29.4 TS1M2
Windows 7 Ultimate 32 bit9.4_M29.4 TS1M2
Windows 7 Ultimate x649.4_M29.4 TS1M2
64-bit Enabled AIX9.4_M29.4 TS1M2
64-bit Enabled Solaris9.4_M29.4 TS1M2
HP-UX IPF9.4_M29.4 TS1M2
Linux for x649.4_M29.4 TS1M2
Solaris for x649.4_M29.4 TS1M2
* For software releases that are not yet generally available, the Fixed Release is the software release in which the problem is planned to be fixed.