Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6109

Support customized location for EXTERNAL tables created by Dynamic Partitioning

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: HCatalog
    • Labels:
      None
    • Release Note:
      A new Job conf property "hcat.dynamic.partitioning.custom.pattern" is introduced that can be configured to provide custom path pattern in case of dynamic partitioning. E.g. "${year}/${month}/${day}/${hour}/${minute}/${country}"

      Description

      Currently when dynamic partitions are created by HCatalog, the underlying directories for the partitions are created in a fixed 'Hive-style' format, i.e. root_dir/key1=value1/key2=value2/.... and so on. However in case of external table, user should be able to control the format of directories created for dynamic partitions.

        Attachments

        1. HIVE-6109.3.patch.txt
          31 kB
          Satish Mittal
        2. HIVE-6109.pdf
          60 kB
          Satish Mittal
        3. HIVE-6109.2.patch.txt
          28 kB
          Satish Mittal
        4. HIVE-6109.1.patch.txt
          28 kB
          Satish Mittal

          Issue Links

            Activity

              People

              • Assignee:
                satish.mittal Satish Mittal
                Reporter:
                satish.mittal Satish Mittal
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: