[HADOOP-11985] Improve Solaris support in Hadoop

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.7.0
• Component/s: build, conf
• Labels: solaris

Environment

Solaris x86, Solaris sparc

• Tags: Solaris Native C x86 sparc
• Assignee: Alan Burlison
• Reporter: Alan Burlison
• Created: 16/May/15 07:56
• Updated: 25/Nov/15 22:52

Description

At present the Hadoop native components aren't fully supported on Solaris primarily due to differences between Linux and Solaris. This top-level task will be used to group together both existing and new issues related to this work. A second goal is to improve Hadoop performance on Solaris wherever possible.

Steve Loughran suggested a top-level JIRA was the best way to manage the work.

Issue Links

• is blocked by: HADOOP-11790 leveldb usage should be disabled by default or smarter about platforms
• is related to: HADOOP-12603 TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail
• is related to: MAPREDUCE-6390 Improve Solaris support in Hadoop Map/Reduce
• relates to: HADOOP-12036 Consolidate all of the cmake extensions in one directory
• relates to: HDFS-8478 Improve Solaris support in HDFS
• relates to: YARN-3719 Improve Solaris support in YARN

Sub-Tasks

• Set up a nightly Jenkins build on Solaris.: Open
• Native compilation fails on Solaris due to use of syscall function.: Open
• Investigate providing SPARC hardware-accelerated CRC32 code: Open
• Investigate JNI for improving byte array comparison performance: Open
• Surefire needs to make sure the JVMs it fires up fit within the memory available: Patch Available
• Make DomainSocket.close() portable: Patch Available
• DomainSocket: Solaris does not support timeouts on AF_UNIX sockets: Patch Available
• Improve versioning and compatibility support in native library for downstream hadoop-common users.: Open
• Hadoop needs a SysInfo class for Solaris: Open
• Sundry symlink problems on Solaris: Open
• Misaligned memory accesses in CRC32 native code causes coredumps: Open
• Misuse of sun.misc.Unsafe by org.apache.hadoop.io.FastByteComparisons causes misaligned memory access coredumps: Open
• Misuse of sun.misc.Unsafe by org.apache.hadoop.io.FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo causes misaligned memory access coredumps: Open