Hive
  1. Hive
  2. HIVE-6347

ZeroCopy read path for ORC RecordReader

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: tez-branch
    • Fix Version/s: tez-branch
    • Component/s: File Formats
    • Labels:
      None
    • Release Note:
      ZeroCopy readers for the ORC file format

      Description

      ORC can use the new HDFS Caching APIs and the ZeroCopy readers to avoid extra data copies into memory while scanning files.

      Implement ORC zcr codepath and a hive.orc.zerocopy flag.

      1. HIVE-6347.1.patch
        26 kB
        Gopal V
      2. HIVE-6347.2-tez.patch
        27 kB
        Gopal V
      3. HIVE-6347.3-tez.patch
        27 kB
        Gopal V
      4. HIVE-6347.4-tez.patch
        26 kB
        Gopal V
      5. HIVE-6347.5-tez.patch
        24 kB
        Gopal V

        Issue Links

          Activity

          Gopal V created issue -
          Gopal V made changes -
          Field Original Value New Value
          Link This issue is blocked by HADOOP-10047 [ HADOOP-10047 ]
          Gopal V made changes -
          Link This issue is blocked by HIVE-6346 [ HIVE-6346 ]
          Gopal V made changes -
          Link This issue is related to HDFS-4949 [ HDFS-4949 ]
          Gopal V made changes -
          Attachment HIVE-6347.1.patch [ 12626451 ]
          Gopal V made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note ZeroCopy readers for the ORC file format
          Prasanth Jayachandran made changes -
          Link This issue blocks HIVE-6382 [ HIVE-6382 ]
          Gopal V made changes -
          Attachment HIVE-6347.2-tez.patch [ 12629191 ]
          Gopal V made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Gopal V made changes -
          Attachment HIVE-6347.3-tez.patch [ 12629192 ]
          Gopal V made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Gopal V made changes -
          Link This issue is related to HDFS-5957 [ HDFS-5957 ]
          Gopal V made changes -
          Attachment HIVE-6347.4-tez.patch [ 12629484 ]
          Gopal V made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Gopal V made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Gopal V made changes -
          Attachment HIVE-6347.5-tez.patch [ 12631167 ]
          Gunther Hagleitner made changes -
          Fix Version/s tez-branch [ 12324744 ]
          Gunther Hagleitner made changes -
          Link This issue is related to HIVE-6360 [ HIVE-6360 ]
          Gunther Hagleitner made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              Gopal V
              Reporter:
              Gopal V
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development