Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-16085

get path-to-alias, path-to-work etc recursively in Hive

    XMLWordPrintableJSON

Details

    • Task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Sometimes, we don't get correct alias/part desc/etc. from a split path because the path has subdirectories - e.g. in HIVE-15870 (for MM tables).
      We have utility methods to work around that by getting the partdesc recursively from the parents of a path, but they are not applied consistently; I suspect people add calls to these methods after they discover some particular codepath is broken. Perhaps we should find such places proactively for path-to-part, path-to-work, and path-to-alias maps.
      This can happen much more with MM tables, but can also happen for any recursive-path cases (incl. just a regular recursive path read enabled via an MR config).

      Attachments

        1. HIVE-16085.WIP.patch
          21 kB
          Sergey Shelukhin

        Issue Links

          Activity

            People

              sershe Sergey Shelukhin
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: