Hive
  1. Hive
  2. HIVE-3231

msck repair should find partitions already containing data files

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.1, 0.10.0
    • Fix Version/s: 0.11.0
    • Component/s: Metastore
    • Labels:

      Description

      msck repair currently will only discover partition directories if they are empty.

      It seems a more apt use case to copy data files into a table, creating the partition directories as you go, rather than creating a bunch of empty partition directories, then running msck repair to dynamically add them, then inserting your actual data files.

      1. HIVE-3231.2.patch.txt
        2 kB
        Keegan Mosley
      2. HIVE-3231.1.patch.txt
        1 kB
        Keegan Mosley

        Activity

        Keegan Mosley created issue -
        Keegan Mosley made changes -
        Field Original Value New Value
        Attachment HIVE-3231.1.patch.txt [ 12535235 ]
        Keegan Mosley made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 0.10.0 [ 12320745 ]
        Keegan Mosley made changes -
        Priority Minor [ 4 ] Major [ 3 ]
        Carl Steinbach made changes -
        Component/s Metastore [ 12312584 ]
        Carl Steinbach made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Carl Steinbach made changes -
        Assignee Keegan Mosley [ kmosley ]
        Keegan Mosley made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        Keegan Mosley made changes -
        Attachment HIVE-3231.2.patch.txt [ 12549715 ]
        Keegan Mosley made changes -
        Status In Progress [ 3 ] Patch Available [ 10002 ]
        Assignee Keegan Mosley [ kmosley ] Carl Steinbach [ cwsteinbach ]
        Ashutosh Chauhan made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.11 [ 12323587 ]
        Fix Version/s 0.10.0 [ 12320745 ]
        Resolution Fixed [ 1 ]
        Owen O'Malley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Carl Steinbach
            Reporter:
            Keegan Mosley
          • Votes:
            1 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development