Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-482

Error writing to OrcNewOutputFormat using MapR MultipleOutputs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      We reading data from ORC files and writing it back to ORC and Parquet format using MultipleOutputs. Our job is Map only and does not have a reducer. We are getting following type of errors in some mappers which fails the entire job. Let me know if more information is required.

       

      Error: java.lang.RuntimeException: Overflow of newLength. smallBuffer.length=1073741824, nextElemLength=300947 

      Attachments

        Issue Links

          is fixed by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-25190 BytesColumnVector fails when the aggregate size is > 1gb

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              aniruddha_1990 Aniruddha
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: