Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6405 Support append feature for HCatalog
  3. HIVE-6476

Support Append with Dynamic Partitioning

    XMLWordPrintableJSON

Details

    Description

      Currently, we do not support mixing dynamic partitioning and append in the same job. One reason is that we need exhaustive testing of corner cases for that, and a second reason is the behaviour of add_partitions. To support dynamic partitioning with append, we'd have to have a add_partitions_if_not_exist call, rather than an add_partitions call.

      Thus, the current implementation in HIVE-6475 assumes immutability for all dynamic partitioning jobs, irrespective of whether or not the table is marked as mutable or not.

      Attachments

        1. HIVE-6476.1.patch
          26 kB
          Mariappan Asokan

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-6897 Allow overwrite/append to external Hive table (with partitions) via HCatStorer

          • Major - Major loss of function.
          • Open

          Activity

            People

              masokan Mariappan Asokan
              sushanth Sushanth Sowmyan
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: