Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3815

Hadoop bug causes to pig to fail silently with jar cache

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.13.0
    • 0.13.0
    • None
    • None

    Description

      Pig uses DistributedCache.addFileToClassPath api that puts jars on distributed cache configuration. This uses : to separate list of files to be put of classpath via distributed cache. If fs.default.name has port number in it, it causes the tokenization logic to fail in hadoop for retrieving list of cache filenames in backend.

      Attachments

        1. PIG-3815.patch
          2 kB
          Aniket Namadeo Mokashi
        2. PIG-3815-1.patch
          3 kB
          Aniket Namadeo Mokashi
        3. PIG-3815-2.patch
          1 kB
          Aniket Namadeo Mokashi
        4. PIG-3815-3.patch
          2 kB
          Aniket Namadeo Mokashi

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. PIG-5290 User Cache upload contention can cause job failures

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              aniket486 Aniket Namadeo Mokashi
              aniket486 Aniket Namadeo Mokashi
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: