Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2318

Use hadoop configuration defaults for MapReduceSubmissionEngine

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • None
    • 1.99.7
    • sqoop2-framework
    • None

    Description

      Found this while trying to run a local job runner out of the box for development testing.

      The MapReduceSubmissionEngine looks in /etc/hadoop/conf for hadoop configurations. When trying to run a local job runner without an actual hadoop install, this forces the user to create an /etc/hadoop/conf directory, and then put a lot of configs in there to get local job runner to work.

      Proposing a change to use hadoop defaults (comes with Hadoop Configuration object), which will make local job runner work out of the box. Though, empty /etc/hadoop/conf directory still needs to be created.

      Attachments

        1. SQOOP-2318.2.patch
          2 kB
          Szehon Ho
        2. SQOOP-2318.patch
          0.8 kB
          Szehon Ho

        Activity

          People

            szehon Szehon Ho
            szehon Szehon Ho
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: