Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-933

Infer bucketing/sorting properties

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This is a long-term plan, and may require major changes.

      From the query, we can figure out the sorting/bucketing properties, and change the metadata of the destination at that time.
      However, this means that different partitions may have different metadata. Currently, the query plan is same for all the
      partitions of the table - we can do the following:

      1. In the first cut, have a simple approach where you take the union all metadata, and create the most defensive plan.
      2. Enhance mapredWork() to include partition specific operator trees.

        Attachments

        1. HIVE-933.1.patch.txt
          403 kB
          Kevin Wilfong
        2. HIVE-933.10.patch.txt
          708 kB
          Kevin Wilfong
        3. HIVE-933.11.patch.txt
          573 kB
          Kevin Wilfong
        4. HIVE-933.12.patch.txt
          581 kB
          Kevin Wilfong
        5. HIVE-933.13.patch.txt
          581 kB
          Kevin Wilfong
        6. HIVE-933.2.patch.txt
          403 kB
          Kevin Wilfong
        7. HIVE-933.3.patch.txt
          493 kB
          Kevin Wilfong
        8. HIVE-933.4.patch.txt
          588 kB
          Kevin Wilfong
        9. HIVE-933.5.patch.txt
          752 kB
          Kevin Wilfong
        10. HIVE-933.6.patch.txt
          741 kB
          Kevin Wilfong
        11. HIVE-933.7.patch.txt
          702 kB
          Kevin Wilfong
        12. HIVE-933.8.patch.txt
          747 kB
          Kevin Wilfong
        13. HIVE-933.9.patch.txt
          748 kB
          Kevin Wilfong

          Issue Links

            Activity

              People

              • Assignee:
                kevinwilfong Kevin Wilfong
                Reporter:
                namit Namit Jain
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: