Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2215

ResettableFileInputStream can't support ucs-4 character

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.5.0
    • 1.7.0
    • None

    Description

      ResettableFileInputStream.java:readChar() not handle ucs-4 character. it need 2 charBuf. it cause an unexpected termination。
      a temporary solution:
      if (res.isOverflow() && !charBuf.hasRemaining()){
      logger.warn("decoder ucs-4 at postion: {}" , buf.position());
      tmpBuf.clear();
      res = decoder.decode(buf, tmpBuf, isEndOfInput);
      incrPosition( buf.position() - start, false);
      return '?';
      }

      Attachments

        1. 0001-FLUME-2215-Fixes-reading-surrogate-based-chars.patch
          7 kB
          Patrick Sodre
        2. FLUME-2215-0.patch
          26 kB
          Alexandre Dutra
        3. FLUME-2215-0-README.txt
          4 kB
          Alexandre Dutra
        4. FLUME-2215-1.patch
          205 kB
          Alexandre Dutra
        5. FLUME-2215-1-README.txt
          5 kB
          Alexandre Dutra

        Issue Links

          Activity

            People

              adutra Alexandre Dutra
              syntonyliu syntony liu
              Votes:
              4 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: