Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1260

HADOOP_MAPRED_HOME should be defaulted correctly

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.5
    • Component/s: None
    • Labels:
      None
    • Environment:

      Hadoop 2.x

      Description

      When running Sqoop on Hadoop 2.x which has been installed using the BigTop layout (with a custom hadoop-layout.sh), we run into issues in a setup where only Hadoop and sqoop are installed with the failure in the compilation of the generated Java file.

      This is because in Sqoop, the HADOOP_MAPRED_HOME is defaulted to HADOOP_HOME (/usr/lib/hadoop by default) when the variable is not set.

      This results in the mapreduce libraries not being added to the classpath and hence the failure. If we have HBase installed, then we add the HBase classpath which causes the mapreduce libraries to be brought into the classpath and hence we don't see the issue.

      We should default HADOOP_MAPRED_HOME to /usr/lib/hadoop-mapreduce (the BigTop default) if the directory is present else default to HADOOP_HOME

        Attachments

        1. SQOOP-1260-2.patch
          0.7 kB
          Venkat Ranganathan
        2. SQOOP-1260.patch
          1 kB
          Venkat Ranganathan

          Issue Links

            Activity

              People

              • Assignee:
                venkatnrangan Venkat Ranganathan
                Reporter:
                venkatnrangan Venkat Ranganathan
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: