Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4554

Compress pig.script before encoding

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.14.0
    • 0.16.0
    • None
    • Reviewed

    Description

      Currently we truncate the pig script (maxScriptSize = 10240) and base64 encode it and store in config. We should remove the truncation and store the full script by compressing and then doing base64 encoding. We already do that for udfcontext, etc. It will save space as it will compress really well and will also give the full pig script while debugging.

      Attachments

        1. PIG-4554.patch
          5 kB
          Sandeep Samdaria
        2. PIG-4554-2.patch
          8 kB
          Sandeep Samdaria
        3. PIG-4554-3.patch
          8 kB
          Sandeep Samdaria
        4. PIG-4554-4.patch
          9 kB
          Rohini Palaniswamy

        Activity

          People

            sandyridgeracer Sandeep Samdaria
            rohini Rohini Palaniswamy
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: