Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
Currently, when run spark tasks, spark will report cannot load hadoop native libraries.
Also, the hadoop short-circuit read feature cannot be applied. For better performance, add hadoop native libraries support.
Some WARN log as following:
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
23/08/15 13:43:22 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Screen shot:
...
23/08/15 13:43:25 INFO Client: Requesting a new application from cluster with 3 NodeManagers
23/08/15 13:43:26 WARN DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
23/08/15 13:43:26 INFO Configuration: resource-types.xml not found
Screen shot:
Attachments
Attachments
Issue Links
- Blocked
-
AMBARI-26001 ambari2.8 release
- Open
- links to