Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-457

ScriptOperator should NOT cache all data in stderr

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Sometimes user scripts output a lot of data to stderr without a new line, and this causes Hive to go out-of-memory.
      We should directly output the data from stderr without caching it.

        Attachments

        1. HIVE-457.2.patch
          2 kB
          Paul Yang
        2. HIVE-457.1.patch
          0.9 kB
          Paul Yang
        3. err.sh
          0.1 kB
          Paul Yang

          Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-690 ScriptOperator still times out

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

            Activity

              People

              • Assignee:
                pauly Paul Yang
                Reporter:
                zshao Zheng Shao
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated: