Github user RamVenkatesh commented on the pull request:
@jongyoul , @Leemoonsoo @echarles thank you all for your comments, appreciate it.
A few more points:
1. Without this change, our Zeppelin installation is completely broken - am upping the priority of this bug to blocker to expedite resolution.
2. Even though the Spark project built against Hadoop 2.4, Spark 1.2.1 + Hadoop 2.6 is a valid tested configuration in some Spark distros, HDP for example. And this is optional, so people who want the stock Spark experience can specify the 2.4 profile.
3. Hadoop 2.4 and Hadoop 2.6 are not identical, there are a number of fixes in 2.6 that we will need and independent of this discussion we will need a way to build with Hadoop 2.6. Modifying the 2.4 profile to specify 2.6 does not seem the best option to me.
IMO everything we can do to help with adoption out of the box should be our priority now.
To address the maintenance concern, may I suggest we add a Hadoop 2.6 profile now, which can be removed at what the community thinks is the right time?