Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19205 Hive streaming ingest improvements (v2)
  3. HIVE-19214

High throughput ingest ORC format

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.1.0, 3.0.0
    • 3.1.0, 3.0.0
    • Streaming
    • None

    Description

      Create delta files with all ORC overhead disabled (no index, no compression, no dictionary). Compactor will recreate the orc files with index, compression and dictionary encoding.

      Attachments

        1. HIVE-19214.1.patch
          5 kB
          Prasanth Jayachandran
        2. HIVE-19214.2.patch
          5 kB
          Prasanth Jayachandran
        3. HIVE-19214.3.patch
          21 kB
          Prasanth Jayachandran
        4. HIVE-19214.4.patch
          21 kB
          Prasanth Jayachandran
        5. HIVE-19214.5.patch
          23 kB
          Prasanth Jayachandran

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. HIVE-20418 LLAP IO may not handle ORC files that have row index disabled correctly for queries with no columns selected

          • Major - Major loss of function.
          • Closed
          links to

          Web Link RB

          Activity

            People

              prasanth_j Prasanth Jayachandran
              gopalv Gopal Vijayaraghavan
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: