Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14826 Support vectorization for Parquet
  3. HIVE-14815

Implement Parquet vectorization reader for Primitive types

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.3.0
    • Component/s: None
    • Labels:
      None

      Description

      Parquet doesn't provide a vectorized reader which can be used by Hive directly. Also for Decimal Column batch, it consists of a batch of HiveDecimal which is a Hive type which is unknown for Parquet. To support Hive vectorization execution engine in Hive, we have to implement the vectorized Parquet reader in Hive side. To limit the performance impacts, we need to implement a page level vectorized reader.

        Attachments

        1. HIVE-14815.patch
          119 kB
          Ferdinand Xu
        2. HIVE-14815.9.patch
          232 kB
          Ferdinand Xu
        3. HIVE-14815.8.patch
          227 kB
          Ferdinand Xu
        4. HIVE-14815.7.patch
          98 kB
          Ferdinand Xu
        5. HIVE-14815.6.patch
          98 kB
          Ferdinand Xu
        6. HIVE-14815.5.patch
          97 kB
          Ferdinand Xu
        7. HIVE-14815.4.patch
          97 kB
          Ferdinand Xu
        8. HIVE-14815.3.patch
          98 kB
          Ferdinand Xu
        9. HIVE-14815.2.patch
          99 kB
          Ferdinand Xu
        10. HIVE-14815.12.patch
          232 kB
          Ferdinand Xu
        11. HIVE-14815.11.patch
          231 kB
          Ferdinand Xu
        12. HIVE-14815.10.patch
          231 kB
          Ferdinand Xu
        13. HIVE-14815.1.patch
          112 kB
          Ferdinand Xu

          Issue Links

            Activity

              People

              • Assignee:
                Ferd Ferdinand Xu
                Reporter:
                Ferd Ferdinand Xu
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: