Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha4
    • Component/s: io
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Use configuration properties io.erasurecode.codec.{rs-legacy,rs,xor}.rawcoders to control erasure coding codec. These properties support codec fallback in case the previous codec is not loaded.

      Description

      The current EC codec supports a single coder only (by default pure Java implementation). If the native coder is specified but is unavailable, it should fallback to pure Java implementation.

      One possible solution is to follow the convention of existing Hadoop native codec, such as transport encryption (see CryptoCodec.java). It supports fallback by specifying two or multiple coders as the value of property, and loads coders in order.

        Attachments

        1. HADOOP-13665.01.patch
          10 kB
          Kai Sasaki
        2. HADOOP-13665.02.patch
          9 kB
          Kai Sasaki
        3. HADOOP-13665.03.patch
          10 kB
          Kai Sasaki
        4. HADOOP-13665.04.patch
          10 kB
          Kai Sasaki
        5. HADOOP-13665.05.patch
          6 kB
          Kai Sasaki
        6. HADOOP-13665.06.patch
          11 kB
          Kai Sasaki
        7. HADOOP-13665.07.patch
          11 kB
          Kai Sasaki
        8. HADOOP-13665.08.patch
          12 kB
          Kai Sasaki
        9. HADOOP-13665.09.patch
          12 kB
          Kai Sasaki
        10. HADOOP-13665.10.patch
          15 kB
          Kai Sasaki
        11. HADOOP-13665.11.patch
          23 kB
          Kai Sasaki
        12. HADOOP-13665.12.patch
          23 kB
          Kai Sasaki

          Issue Links

            Activity

              People

              • Assignee:
                lewuathe Kai Sasaki
                Reporter:
                jojochuang Wei-Chiu Chuang
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: