Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14826 Support vectorization for Parquet
  3. HIVE-14815

Implement Parquet vectorization reader for Primitive types

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None

    Description

      Parquet doesn't provide a vectorized reader which can be used by Hive directly. Also for Decimal Column batch, it consists of a batch of HiveDecimal which is a Hive type which is unknown for Parquet. To support Hive vectorization execution engine in Hive, we have to implement the vectorized Parquet reader in Hive side. To limit the performance impacts, we need to implement a page level vectorized reader.

      Attachments

        1. HIVE-14815.patch
          119 kB
          Ferdinand Xu
        2. HIVE-14815.1.patch
          112 kB
          Ferdinand Xu
        3. HIVE-14815.2.patch
          99 kB
          Ferdinand Xu
        4. HIVE-14815.3.patch
          98 kB
          Ferdinand Xu
        5. HIVE-14815.4.patch
          97 kB
          Ferdinand Xu
        6. HIVE-14815.5.patch
          97 kB
          Ferdinand Xu
        7. HIVE-14815.6.patch
          98 kB
          Ferdinand Xu
        8. HIVE-14815.7.patch
          98 kB
          Ferdinand Xu
        9. HIVE-14815.8.patch
          227 kB
          Ferdinand Xu
        10. HIVE-14815.9.patch
          232 kB
          Ferdinand Xu
        11. HIVE-14815.10.patch
          231 kB
          Ferdinand Xu
        12. HIVE-14815.11.patch
          231 kB
          Ferdinand Xu
        13. HIVE-14815.12.patch
          232 kB
          Ferdinand Xu

        Issue Links

          Activity

            People

              Ferd Ferdinand Xu
              Ferd Ferdinand Xu
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: