Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3914

Recovering a large DAG fails to size limit exceeded

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.9.2
    • None
    • None
    • Reviewed

    Description

      A large message will be failed to parse and will be treated as recovery file EOF.

      2018-04-16 15:33:59,807 WARN  [Thread-2] app.RecoveryParser (RecoveryParser.java:parseRecoveryData(771)) - Corrupt data found when trying to read next event
      com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large.  May be malicious.  Use CodedInputStream.setSizeLimit() to increase the size limit.
      

      Attachments

        1. TEZ-3914.001.patch
          55 kB
          Jonathan Turner Eagles
        2. TEZ-3914.002.patch
          56 kB
          Jonathan Turner Eagles
        3. TEZ-3914.003.patch
          65 kB
          Jonathan Turner Eagles
        4. TEZ-3914.004.patch
          65 kB
          Jonathan Turner Eagles
        5. TEZ-3914.005.patch
          65 kB
          Jonathan Turner Eagles
        6. TEZ-3914.006.patch
          67 kB
          Jonathan Turner Eagles

        Activity

          People

            jeagles Jonathan Turner Eagles
            jeagles Jonathan Turner Eagles
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: