Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2712

Run only one map task attempt during export (second edition)

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.6
    • Fix Version/s: 1.4.7
    • Component/s: None
    • Labels:
      None

      Description

      In SQOOP-2055 I've provided facility to not run multiple map task attempts by default in export case as that doesn't make sense in most scenarios. However looking closely into the patch, it seems that I did a small typo:

          int sqoopMaxAttempts = conf.getInt(SQOOP_EXPORT_MAP_TASK_MAX_ATTEMTPS, 1);
          if (sqoopMaxAttempts > 1) {
            conf.setInt(HADOOP_MAP_TASK_MAX_ATTEMTPS, sqoopMaxAttempts);
          }
      

      Since SQOOP_EXPORT_MAP_TASK_MAX_ATTEMTPS is 1 by default, the if statement won't be called at all and hence we won't limit the number of attempts to 1 as expected. We should fix the condition to sqoopMaxAttempts >0 instead.

        Attachments

        1. SQOOP-2712.patch
          0.7 kB
          Jarek Jarcec Cecho

          Issue Links

            Activity

              People

              • Assignee:
                jarcec Jarek Jarcec Cecho
                Reporter:
                jarcec Jarek Jarcec Cecho
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: