Installation Note 65962: Deploying the SAS® Data Loader for Hadoop web application fails with a "java.lang" error when using Hortonworks 3 or Cloudera 6 or later
 |  |  |  |
When you try to deploy the SAS Data Loader for Hadoop web application using Hortonworks 3, Cloudera 6, or later versions, the deployment fails with one or more of the following errors in the Lev1/Web/WebAppServer/SASServer15_1/logs/catalina.out directory:
java.lang.NoSuchMethodError: org.apache.curator.CuratorZookeeperClient.startAdvancedTracer(Ljava/lang/String;)Lorg/apache/curator/drivers/OperationTrace;
Caused by: java.lang.NoSuchMethodError: org.apache.logging.log4j.Logger.debug(Ljava/lang/String;Ljava/lang/Object;)V
2020-02-26 00:32:28,703 ERROR (localhost-startStop-3) [org.apache.catalina.startup.HostConfig] Error deploying configuration descriptor [/opt/config/Lev1/Web/WebAppServer/SASServer15_1/conf/Catalina/localhost/SASWebProfile.xml]
2020-02-26 00:32:32,345 ERROR (localhost-startStop-1) [org.apache.catalina.core.ContainerBase] ContainerBase.addChild: start:
Caused by: java.lang.NoSuchMethodError: org.apache.logging.log4j.Logger.debug(Ljava/lang/String;Ljava/lang/Object;)V
2020-02-26 00:32:32,346 ERROR (localhost-startStop-1) [org.apache.catalina.startup.HostConfig] Error deploying configuration descriptor [/opt/config/Lev1/Web/WebAppServer/SASServer15_1/conf/Catalina/localhost/SASDataLoader.xml]
2020-02-26 00:32:36,409 ERROR (localhost-startStop-2) [org.apache.catalina.core.ContainerBase] ContainerBase.addChild: start:
Caused by: java.lang.NoSuchMethodError: org.apache.logging.log4j.Logger.debug(Ljava/lang/String;Ljava/lang/Object;)V
2020-02-26 00:32:36,410 ERROR (localhost-startStop-2) [org.apache.catalina.startup.HostConfig] Error deploying configuration descriptor [/opt/config/Lev1/Web/WebAppServer/SASServer15_1/conf/Catalina/localhost/SASDMSharedServices.xml]
2020-02-26 13:34:05,735 [tomcat-http--7] DEBUG [sasdemo] com.sas.dm.datadirector.web.utils.exception.DataDirectorExceptionResourceKeyFactory - checking custom provider map for exception class: com.sas.dm.datadirector.spi.exception.DataDirectorInitializationException
2020-02-26 13:34:05,735 [tomcat-http--7] DEBUG [sasdemo] com.sas.dm.datadirector.web.utils.exception.DataDirectorExceptionResourceKeyFactory - no custom exception resource key provider found, using the default
2020-02-26 13:34:05,735 [tomcat-http--7] INFO [sasdemo] com.sas.dm.services.datadirector.TopLevelController - model already in error state, not reporting back the following error:
com.sas.dm.datadirector.spi.exception.DataDirectorInitializationException: An exception occurred while retrieving the user's granted capabilities There may be an issue with the application configuration.
at com.sas.dm.services.datadirector.rest.UIRestControllerBase.getGrantedCapabilities(UIRestControllerBase.java:628)
at com.sas.dm.services.datadirector.rest.UIRestControllerBase.populateModelWithApplicationInfo(UIRestControllerBase.java:527)
at com.sas.dm.services.datadirector.TopLevelController.getIndex(TopLevelController.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at com.sas.svcs.dm.hadoop.util.HadoopConfigurationBean.init(HadoopConfigurationBean.java:181)
at com.sas.svcs.dm.hadoop.util.HadoopConfigurationBean.getConfiguration(HadoopConfigurationBean.java:126)
Also, the Lev1/Web/Logs/SASServer15_1 folder is not created when you experience this issue.
Cause
The problem occurs because the SAS Data Loader for Hadoop middle tier is not deploying or starting with collected HDP3 JAR files. The Hadoop Tracer script collects approximately 270 JAR files. Multiple JAR files are causing CLASSPATH conflicts that cause the web application to not deploy.
Workaround
To work around the problem, you must modify the JAR files collected by the SAS Hadoop Tracer script for the SAS/ACCESS® Interface to Hadoop configuration to deploy the SAS Data Loader for Hadoop web application. Use the following JAR files (the exact version number might differ slightly) when configuring SAS Data Loader for Hadoop for Hortonworks 3 and later.
It is important to have only the following JAR files on your SAS middle tier in /opt/config/Lev1/Web/Applications/DataLoader/Hadoop/Jars/ if your deployment fails or starting the SAS Data Loader application fails when using Hortonworks 3.
|
activation-1.1.jar activation.jar antlr-runtime-3.4.jar aopalliance-1.0.jar apacheds-i18n-2.0.0-M19.jar apacheds-kerberos-codec-2.0.0-M19.jar apache-log4j-extras-1.2.17.jar api-asn1-api-1.0.0-M26.jar api-util-1.0.0-M26.jar asm-3.2.jar automaton-1.11-8.jar avatica-1.8.0.2.6.4.0-91.jar avro-1.7.4.jar aws-java-sdk-core-1.10.6.jar aws-java-sdk-kms-1.10.62.jar aws-java-sdk-s3-1.10.62.jar azure-data-lake-store-sdk-2.1.4.jar azure-keyvault-core-0.8.0.jar azure-storage-5.4.0.jar calcite-core-1.2.0.2.6.4.0-91.jar calcite-linq4j-1.2.0.2.6.4.0-91.jar commons-beanutils-1.7.0.jar commons-beanutils-core-1.8.0.jar commons-cli-1.2.jar commons-codec-1.4.jar commons-collections-3.2.2.jar commons-collections4-4.1.jar commons-compress-1.4.1.jar commons-configuration-1.6.jar commons-configuration2-2.1.1.jar commons-daemon-1.0.13.jar commons-digester-1.8.jar commons-httpclient-3.1.jar commons-io-2.4.jar commons-lang-2.6.jar commons-lang3-3.4.jar commons-logging-1.1.3.jar commons-logging-1.2.jar commons-math3-3.1.1.jar commons-net-3.1.jar curator-client-2.12.0.jar curator-framework-2.12.0.jar curator-recipes-2.7.1.jar fst-2.24.jar gson-2.2.4.jar guava-14.0.1.jar guice-3.0.jar guice-servlet-3.0.jar hadoop-aliyun-3.1.1.3.1.0.162-1.jar hadoop-annotations-3.1.1.3.1.0.162-1.jar hadoop-archive-logs-3.1.1.3.1.0.162-1.jar hadoop-archives-3.1.1.3.1.0.162-1.jar hadoop-auth-3.1.1.3.1.0.162-1.jar hadoop-common-3.1.1.3.1.0.162-1.jar hadoop-common-3.1.1.3.1.0.162-1-tests.jar hadoop-datajoin-3.1.1.3.1.0.162-1.jar hadoop-distcp-3.1.1.3.1.0.162-1.jar hadoop-extras-3.1.1.3.1.0.162-1.jar hadoop-gridmix-3.1.1.3.1.0.162-1.jar hadoop-hdfs-3.1.1.3.1.0.162-1.jar hadoop-hdfs-3.1.1.3.1.0.162-1-tests.jar hadoop-hdfs-client-3.1.1.3.1.0.162-1.jar hadoop-hdfs-client-3.1.1.3.1.0.162-1-tests.jar hadoop-hdfs-httpfs-3.1.1.3.1.0.162-1.jar hadoop-hdfs-native-client-3.1.1.3.1.0.162-1.jar hadoop-hdfs-native-client-3.1.1.3.1.0.162-1-tests.jar hadoop-hdfs-nfs-3.1.1.3.1.0.162-1.jar hadoop-hdfs-rbf-3.1.1.3.1.0.162-1.jar hadoop-hdfs-rbf-3.1.1.3.1.0.162-1-tests.jar hadoop-kafka-3.1.1.3.1.0.162-1.jar hadoop-kms-3.1.1.3.1.0.162-1.jar hadoop-lzo-0.6.0.3.1.0.162-1.jar hadoop-lzo-0.6.0.3.1.0.162-1-sources.jar hadoop-mapreduce-client-app-3.1.1.3.1.0.162-1.jar hadoop-mapreduce-client-common-3.1.1.3.1.0.162-1.jar hadoop-mapreduce-client-core-3.1.1.3.1.0.162-1.jar hadoop-mapreduce-client-hs-3.1.1.3.1.0.162-1.jar |
hadoop-mapreduce-client-hs-plugins-3.1.1.3.1.0.162-1.jar hadoop-mapreduce-client-jobclient-3.1.1.3.1.0.162-1.jar hadoop-mapreduce-client-jobclient-3.1.1.3.1.0.162-1-tests.jar hadoop-mapreduce-client-nativetask-3.1.1.3.1.0.162-1.jar hadoop-mapreduce-client-shuffle-3.1.1.3.1.0.162-1.jar hadoop-mapreduce-client-uploader-3.1.1.3.1.0.162-1.jar hadoop-mapreduce-examples-3.1.1.3.1.0.162-1.jar hadoop-nfs-3.1.1.3.1.0.162-1.jar hadoop-openstack-3.1.1.3.1.0.162-1.jar hadoop-resourceestimator-3.1.1.3.1.0.162-1.jar hadoop-rumen-3.1.1.3.1.0.162-1.jar hadoop-shim-2.8-0.9.1.3.1.0.162-1.jar hadoop-sls-3.1.1.3.1.0.162-1.jar hadoop-streaming-3.1.1.3.1.0.162-1.jar hadoop-yarn-api-3.1.1.3.1.0.162-1.jar hadoop-yarn-applications-distributedshell-3.1.1.3.1.0.162-1.jar hadoop-yarn-applications-unmanaged-am-launcher-3.1.1.3.1.0.162-1.jar hadoop-yarn-client-3.1.1.3.1.0.162-1.jar hadoop-yarn-common-3.1.1.3.1.0.162-1.jar hadoop-yarn-registry-3.1.1.3.1.0.162-1.jar hadoop-yarn-server-applicationhistoryservice-3.1.1.3.1.0.162-1.jar hadoop-yarn-server-common-3.1.1.3.1.0.162-1.jar hadoop-yarn-server-nodemanager-3.1.1.3.1.0.162-1.jar hadoop-yarn-server-resourcemanager-3.1.1.3.1.0.162-1.jar hadoop-yarn-server-router-3.1.1.3.1.0.162-1.jar hadoop-yarn-server-sharedcachemanager-3.1.1.3.1.0.162-1.jar hadoop-yarn-server-tests-3.1.1.3.1.0.162-1.jar hadoop-yarn-server-timeline-pluginstorage-3.1.1.3.1.0.162-1.jar hadoop-yarn-server-web-proxy-3.1.1.3.1.0.162-1.jar hadoop-yarn-services-api-3.1.1.3.1.0.162-1.jar hadoop-yarn-services-core-3.1.1.3.1.0.162-1.jar hive-beeline-3.1.0.3.1.0.162-1.jar hive-bridge-shim-1.1.0.3.1.0.162-1.jar hive-cli-3.1.0.3.1.0.162-1.jar hive-common-3.1.0.3.1.0.162-1.jar hive-exec-3.1.0.3.1.0.162-1-core.jar hive-exec-3.1.0.3.1.0.162-1.jar hive-hbase-handler-3.1.0.3.1.0.162-1.jar hive-hcatalog-core-3.1.0.3.1.0.162-1.jar hive-hcatalog-server-extensions.jar hive-jdbc-3.1.0.3.1.0.162-1.jar hive-llap-common-3.1.0.3.1.0.162-1.jar hive-llap-server-3.1.0.3.1.0.162-1.jar hive-metastore-3.1.0.3.1.0.71-1.jar hive-service-3.1.0.3.1.0.162-1.jar htrace-core4-4.1.0-incubating.jar htrace-core4.jar httpclient-4.5.2.jar httpcore-4.4.4.jar jackson-annotations-2.9.5.jar jackson-core-2.9.5.jar jackson-core-asl-1.9.13.jar jackson-databind-2.9.5.jar jackson-jaxrs-1.9.13.jar jackson-jaxrs-base-2.9.5.jar jackson-jaxrs-json-provider-2.9.5.jar jackson-mapper-asl-1.9.13.jar jackson-module-jaxb-annotations-2.9.5.jar jackson-xc-1.9.13.jar jaxb1-impl.jar jaxb-api.jar jsp-api-2.1.jar jsr173_1.0_api.jar jsr305-3.0.0.jar jsr311-api-1.1.1.jar log4j-1.2.17.jar log4j-api-2.10.0.jar log4j-core-2.10.0.jar log4j-slf4j-impl-2.10.0.jar re2j-1.1.jar slf4j-api-1.7.25.jar slf4j-log4j12-1.7.25.jar spark stax2-api-3.1.4.jar woodstox-core-5.0.3.jar zookeeper-3.4.6.3.1.0.162-1.jar
|
Operating System and Release Information
| Product Family | Product | System | Product Release | SAS Release | ||
| Reported | Fixed* | Reported | Fixed* | |||
| SAS System | SAS Data Loader for Hadoop | Microsoft® Windows® for x64 | 3.1 | 9.4 TS1M4 | ||
| Microsoft Windows 8 Enterprise 32-bit | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows 8 Enterprise x64 | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows 8 Pro 32-bit | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows 8 Pro x64 | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows 8.1 Enterprise 32-bit | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows 8.1 Enterprise x64 | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows 8.1 Pro 32-bit | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows 8.1 Pro x64 | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows 10 | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows Server 2008 | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows Server 2008 R2 | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows Server 2008 for x64 | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows Server 2012 Datacenter | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows Server 2012 R2 Datacenter | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows Server 2012 R2 Std | 3.1 | 9.4 TS1M4 | ||||
| Microsoft Windows Server 2012 Std | 3.1 | 9.4 TS1M4 | ||||
| Windows 7 Enterprise 32 bit | 3.1 | 9.4 TS1M4 | ||||
| Windows 7 Enterprise x64 | 3.1 | 9.4 TS1M4 | ||||
| Windows 7 Home Premium 32 bit | 3.1 | 9.4 TS1M4 | ||||
| Windows 7 Home Premium x64 | 3.1 | 9.4 TS1M4 | ||||
| Windows 7 Professional 32 bit | 3.1 | 9.4 TS1M4 | ||||
| Windows 7 Professional x64 | 3.1 | 9.4 TS1M4 | ||||
| Windows 7 Ultimate 32 bit | 3.1 | 9.4 TS1M4 | ||||
| Windows 7 Ultimate x64 | 3.1 | 9.4 TS1M4 | ||||
| 64-bit Enabled AIX | 3.1 | 9.4 TS1M4 | ||||
| 64-bit Enabled Solaris | 3.1 | 9.4 TS1M4 | ||||
| HP-UX IPF | 3.1 | 9.4 TS1M4 | ||||
| Linux for x64 | 3.1 | 9.4 TS1M4 | ||||
| Solaris for x64 | 3.1 | 9.4 TS1M4 | ||||
| Type: | Installation Note |
| Priority: | medium |
| Date Modified: | 2021-04-08 10:01:11 |
| Date Created: | 2020-05-13 10:28:39 |