Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11943

[Erasure coding] Warn log frequently print to screen in doEncode/doDecode functions

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha4
    • Fix Version/s: 3.0.0-alpha4
    • Component/s: erasure-coding, native
    • Labels:
      None
    • Environment:

      cluster: 3 nodes
      os:(Red Hat 2.6.33.20, Red Hat 3.10.0-514.6.1.el7.x86_64, Ubuntu4.4.0-31-generic)
      hadoop version: hadoop-3.0.0-alpha4
      erasure coding: XOR-2-1-64k and enabled Intel ISA-L
      hadoop fs -put file /

    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Flags:
      Patch

      Description

      when i write file to hdfs on above environment, the hdfs client frequently print warn log of use direct ByteBuffer inputs/outputs in doEncode function to screen, detail information as follows:
      2017-06-07 15:20:42,856 WARN rawcoder.AbstractNativeRawEncoder: convertToByteBufferState is invoked, not efficiently. Please use direct ByteBuffer inputs/outputs

        Attachments

        1. HDFS-11943.patch
          1 kB
          liaoyuxiangqin
        2. HDFS-11943.005.patch
          3 kB
          liaoyuxiangqin
        3. HDFS-11943.004.patch
          3 kB
          liaoyuxiangqin
        4. HDFS-11943.003.patch
          2 kB
          liaoyuxiangqin
        5. HDFS-11943.002.patch
          1 kB
          liaoyuxiangqin

          Activity

            People

            • Assignee:
              liaoyuxiangqin liaoyuxiangqin
              Reporter:
              liaoyuxiangqin liaoyuxiangqin
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 0.05h
                0.05h
                Remaining:
                Remaining Estimate - 0.05h
                0.05h
                Logged:
                Time Spent - Not Specified
                Not Specified