Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Not a Problem
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      As of today, none of the components in hadoop tools is in the classpath. Historically (from what I was told) these were not in the classpath because there existed other version of these tools that users wanted to run and hence did not want the hadoop tools to be in the classpath by default. Is that still true today?
      Also, if users do want to add their own hadoop tools to the classpath, there are other ways to ensure that the user's classpath is picked up before hadoop's classpath.

      So, if there are no other reasons, can we add hadoop tools to the classpath? Or am I missing something?

        Activity

        Hide
        Allen Wittenauer added a comment -

        Historically (from what I was told) these were not in the classpath because there existed other version of these tools that users wanted to run and hence did not want the hadoop tools to be in the classpath by default. Is that still true today?

        Yes.

        distcp is the big one. We definitely run a custom version as do many other people. Additionally, at least in 0.20.2, there isn't much of a reason to include them in the CLASSPATH:

        • distcp
        • distch
        • har creation
        • logalyzer (which I don't even know what that is)

        all seem pretty non-fundamental to me.

        Looking at 1.x, I still see a lot of non-fundamental bits that most people just really don't need.

        Show
        Allen Wittenauer added a comment - Historically (from what I was told) these were not in the classpath because there existed other version of these tools that users wanted to run and hence did not want the hadoop tools to be in the classpath by default. Is that still true today? Yes. distcp is the big one. We definitely run a custom version as do many other people. Additionally, at least in 0.20.2, there isn't much of a reason to include them in the CLASSPATH: distcp distch har creation logalyzer (which I don't even know what that is) all seem pretty non-fundamental to me. Looking at 1.x, I still see a lot of non-fundamental bits that most people just really don't need.
        Hide
        John George added a comment -

        Allen,
        Thanks for responding. I will close this JIRA. I just wanted to make sure that the use case was still true.

        Show
        John George added a comment - Allen, Thanks for responding. I will close this JIRA. I just wanted to make sure that the use case was still true.

          People

          • Assignee:
            John George
            Reporter:
            John George
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development