Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5839

Provide a boolean switch to enable LazyOutputFormat

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.4.0
    • None
    • client
    • None
    • Hide
      LazyOutputFormat was introduced by HADOOP-4927. However, it's difficult to deal with it when the user interfaces higher-level project such as pig, or cascading. Pig 0.13 already provides a convenient boolean switch pig.output.lazy via PIG-3299.

      Since this is very useful to many other projects, this JIRA proposes to implements this in MapReduce.
      Show
      LazyOutputFormat was introduced by HADOOP-4927 . However, it's difficult to deal with it when the user interfaces higher-level project such as pig, or cascading. Pig 0.13 already provides a convenient boolean switch pig.output.lazy via PIG-3299 . Since this is very useful to many other projects, this JIRA proposes to implements this in MapReduce.

    Attachments

      1. MAPREDUCE-5839.v01.patch
        23 kB
        Gera Shegalov
      2. MAPREDUCE-5839.v02.patch
        23 kB
        Gera Shegalov

      Issue Links

        relates to

        Improvement - An improvement or enhancement to an existing feature or task. PIG-3299 Provide support for LazyOutputFormat to avoid creating empty files

        • Major - Major loss of function.
        • Closed

        Activity

          People

            jira.shegalov Gera Shegalov
            jira.shegalov Gera Shegalov
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated: