Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1134

Skewed Join sampling job overwhelms the name node

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.6.0
    • None
    • None

    Description

      The map tasks of the sampling job estimate the file size. For a large directory and a large number of maps the file system calls over whelm the name node.

      Attachments

        1. PIG-1134.patch
          0.8 kB
          Sriranjan Manjunath

        Activity

          People

            sriranjan Sriranjan Manjunath
            sriranjan Sriranjan Manjunath
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: