Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2215

ResettableFileInputStream can't support ucs-4 character

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.5.0
    • Fix Version/s: 1.7.0
    • Component/s: None
    • Labels:

      Description

      ResettableFileInputStream.java:readChar() not handle ucs-4 character. it need 2 charBuf. it cause an unexpected termination。
      a temporary solution:
      if (res.isOverflow() && !charBuf.hasRemaining()){
      logger.warn("decoder ucs-4 at postion: {}" , buf.position());
      tmpBuf.clear();
      res = decoder.decode(buf, tmpBuf, isEndOfInput);
      incrPosition( buf.position() - start, false);
      return '?';
      }

        Attachments

        1. 0001-FLUME-2215-Fixes-reading-surrogate-based-chars.patch
          7 kB
          Patrick Sodre
        2. FLUME-2215-1-README.txt
          5 kB
          Alexandre Dutra
        3. FLUME-2215-1.patch
          205 kB
          Alexandre Dutra
        4. FLUME-2215-0-README.txt
          4 kB
          Alexandre Dutra
        5. FLUME-2215-0.patch
          26 kB
          Alexandre Dutra

          Issue Links

            Activity

              People

              • Assignee:
                adutra Alexandre Dutra
                Reporter:
                syntonyliu syntony liu
              • Votes:
                4 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: