Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3388

Automatically update information on partition schema

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.17.0
    • None
    • client
    • None

    Description

      After introducing ranges with custom hash schemas with KUDU-2671, after adding/dropping a range with custom hash schema it's necessary to refresh KuduTable handle that is used in the code to write/read data from the table. Otherwise, the information on ranges in custom hash schemas in PartitionSchema (as a part of metadata stored in the KuduTable handle) isn't updated (and operations to insert rows into the newly added range partition would fail, for example).

      It would be great to free application developers from the necessity doing such refresh. One alternative would be storing PartitionSchema of all tables currently open in some sort of catalog in KuduClient, referring to a proper entry from KuduTable handle. Updates of PartitionSchema in the catalog could be done automatically as callbacks for successful completion of AlterTable requests. With that, all KuduTable handles would refer to the very recent info on table's metadata.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              aserbin Alexey Serbin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: