Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6109

Support customized location for EXTERNAL tables created by Dynamic Partitioning

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.13.0
    • HCatalog
    • None
    • A new Job conf property "hcat.dynamic.partitioning.custom.pattern" is introduced that can be configured to provide custom path pattern in case of dynamic partitioning. E.g. "${year}/${month}/${day}/${hour}/${minute}/${country}"

    Description

      Currently when dynamic partitions are created by HCatalog, the underlying directories for the partitions are created in a fixed 'Hive-style' format, i.e. root_dir/key1=value1/key2=value2/.... and so on. However in case of external table, user should be able to control the format of directories created for dynamic partitions.

      Attachments

        1. HIVE-6109.1.patch.txt
          28 kB
          Satish Mittal
        2. HIVE-6109.2.patch.txt
          28 kB
          Satish Mittal
        3. HIVE-6109.pdf
          60 kB
          Satish Mittal
        4. HIVE-6109.3.patch.txt
          31 kB
          Satish Mittal

        Issue Links

          Activity

            People

              satish.mittal Satish Mittal
              satish.mittal Satish Mittal
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: