Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Hadoop by default provides only FileOutputCommitter and the same has been used internally except in the NOF.
      There are cases where using FOC is not much appropriate.

      Example
      DBOutputFormat instantiates FOC, though it does nothing.
      I think using NOC will be much more appropriate here.

      And also it can be used along with other OFs, where taking special care of the task/job output directories may not be required.

      1. MAPREDUCE-3471.patch
        4 kB
        Bhallamudi Venkata Siva Kamesh

        Activity

        Hide
        Bhallamudi Venkata Siva Kamesh added a comment -

        I encountered the importance of NullOutputCommitter, when I was debugging MAPREDUCE-3130. I fixed this by setting OutputCommitter class of FileOutputFormat as NullOutputCommitter. Again for setting this, we need to fix MAPREDUCE-2493.

        Also, OC implementation of NOF returns true for isRecoverySupported(). Why do we need this?

        Providing patch, thinking it may be useful.

        Show
        Bhallamudi Venkata Siva Kamesh added a comment - I encountered the importance of NullOutputCommitter , when I was debugging MAPREDUCE-3130 . I fixed this by setting OutputCommitter class of FileOutputFormat as NullOutputCommitter . Again for setting this, we need to fix MAPREDUCE-2493 . Also, OC implementation of NOF returns true for isRecoverySupported(). Why do we need this? Providing patch, thinking it may be useful.

          People

          • Assignee:
            Unassigned
            Reporter:
            Bhallamudi Venkata Siva Kamesh
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Development