Problem Note 63236: A SAS® Data Studio plan in SAS® Viya® 3.4 can run out of memory if the data plan contains a join for at least one table with a large number of columns
A SAS® Data Studio 2.2 plan that joins a table with a large number of columns with another table can fail in SAS Viya 3.4. The plan fails with the following error:
Handler dispatch failed; nested exception is java.lang.OutOfMemoryError: Java heap space
In addition, the logs for the Authorization, Job Execution, SAS Data Studio, and Data Plans services might contain a number of java.lang.OutOfMemoryError exceptions.
The issue can be circumvented by increasing the -Xmx memory settings for Java Virtual Machine (JVM) in SAS® Environment Manager. Adjust the -Xmx parameter for the following services: Authorization, Job Execution, SAS Data Studio, and Data Plans. The parameter needs to be set between 4096m and 8192m, and possibly higher, depending on the sizes of the tables that are joined.
Take the following steps to modify the -Xmx JVM parameter settings:
- Sign in as an administrator to the SAS Viya user interface.
- Click Yes to the prompt to opt in to the assumable groups.
- On the main menu, select Manage Environment to open SAS Environment Manager.
- In SAS Environment Manager, select Configuration from the left-hand navigation menu.
- Select View ► All Services.
- Click an affected service (Authorization service, Data Plans service, Job Execution service, and SAS Data Studio).
- For each service, click the Edit button for the JVM section, and modify the java_option_xmx setting to -Xmx4096m.
- Restart any modified services by issuing the sudo service sas-viya-service-name-default restart command. For service-name, substitute the correct information as appropriate.
- Run the data plan. If it fails, repeat these steps. Each time, increase the -Xmx parameter value by at least 1024 until all out-of-memory exceptions are resolved.
Click the Hot Fix tab in this note to access the hot fix for this issue.
After you apply the hot fix, the amount of memory that is required to execute a plan successfully is decreased. However, you still might need to adjust the -Xmx settings for the Data Plans and Job Execution services.
Operating System and Release Information
SAS System | SAS Viya | Microsoft Windows Server 2012 Datacenter | 3.4 | 3.4 | | Viya |
Microsoft Windows Server 2012 Std | 3.4 | 3.4 | | Viya |
Linux for x64 | 3.4 | 3.4 | | Viya |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
A data plan that joins a table with a large number of columns with another table might result in an out-of-memory condition in SAS Data Studio.
Type: | Problem Note |
Priority: | high |
Date Modified: | 2018-12-05 09:14:45 |
Date Created: | 2018-11-15 13:41:03 |