Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2215

ResettableFileInputStream can't support ucs-4 character

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.5.0
    • 1.7.0
    • None

    Description

      ResettableFileInputStream.java:readChar() not handle ucs-4 character. it need 2 charBuf. it cause an unexpected termination。
      a temporary solution:
      if (res.isOverflow() && !charBuf.hasRemaining()){
      logger.warn("decoder ucs-4 at postion: {}" , buf.position());
      tmpBuf.clear();
      res = decoder.decode(buf, tmpBuf, isEndOfInput);
      incrPosition( buf.position() - start, false);
      return '?';
      }

      Attachments

        1. 0001-FLUME-2215-Fixes-reading-surrogate-based-chars.patch
          7 kB
          Patrick Sodre
        2. FLUME-2215-0.patch
          26 kB
          Alexandre Dutra
        3. FLUME-2215-0-README.txt
          4 kB
          Alexandre Dutra
        4. FLUME-2215-1.patch
          205 kB
          Alexandre Dutra
        5. FLUME-2215-1-README.txt
          5 kB
          Alexandre Dutra

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            adutra Alexandre Dutra
            syntonyliu syntony liu
            Votes:
            4 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment