Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha4
    • Component/s: io
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Use configuration properties io.erasurecode.codec.{rs-legacy,rs,xor}.rawcoders to control erasure coding codec. These properties support codec fallback in case the previous codec is not loaded.

      Description

      The current EC codec supports a single coder only (by default pure Java implementation). If the native coder is specified but is unavailable, it should fallback to pure Java implementation.

      One possible solution is to follow the convention of existing Hadoop native codec, such as transport encryption (see CryptoCodec.java). It supports fallback by specifying two or multiple coders as the value of property, and loads coders in order.

        Attachments

        1. HADOOP-13665.12.patch
          23 kB
          Kai
        2. HADOOP-13665.11.patch
          23 kB
          Kai
        3. HADOOP-13665.10.patch
          15 kB
          Kai
        4. HADOOP-13665.09.patch
          12 kB
          Kai
        5. HADOOP-13665.08.patch
          12 kB
          Kai
        6. HADOOP-13665.07.patch
          11 kB
          Kai
        7. HADOOP-13665.06.patch
          11 kB
          Kai
        8. HADOOP-13665.05.patch
          6 kB
          Kai
        9. HADOOP-13665.04.patch
          10 kB
          Kai
        10. HADOOP-13665.03.patch
          10 kB
          Kai
        11. HADOOP-13665.02.patch
          9 kB
          Kai
        12. HADOOP-13665.01.patch
          10 kB
          Kai

          Issue Links

            Activity

              People

              • Assignee:
                lewuathe Kai
                Reporter:
                weichiu Wei-Chiu Chuang
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: