Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21346 Refactor Hive DDL
  3. HIVE-21292

Break up DDLTask - extract Database related operations

    XMLWordPrintableJSON

Details

    Description

      DDLTask is a huge class, more than 5000 lines long. The related DDLWork is also a huge class, which has a field for each DDL operation it supports. The goal is to refactor these in order to have everything cut into more handleable classes under the package  org.apache.hadoop.hive.ql.exec.ddl:

      • have a separate class for each operation
      • have a package for each operation group (database ddl, table ddl, etc), so the amount of classes under a package is more manageable
      • make all the requests (DDLDesc subclasses) immutable
      • DDLTask should be agnostic to the actual operations
      • right now let's ignore the issue of having some operations handled by DDLTask which are not actual DDL operations (lock, unlock, desc...)

      In the interim time when there are two DDLTask and DDLWork classes in the code base the new ones in the new package are called DDLTask2 and DDLWork2 thus avoiding the usage of fully qualified class names where both the old and the new classes are in use.

      Step #1: extract all the database related operations from the old DDLTask, and move them under the new package. Also create the new internal framework.

      Attachments

        1. HIVE-21292.01.patch
          154 kB
          Miklos Gergely
        2. HIVE-21292.02.patch
          162 kB
          Miklos Gergely
        3. HIVE-21292.03.patch
          166 kB
          Miklos Gergely
        4. HIVE-21292.04.patch
          166 kB
          Miklos Gergely
        5. HIVE-21292.05.patch
          166 kB
          Miklos Gergely
        6. HIVE-21292.06.patch
          169 kB
          Miklos Gergely
        7. HIVE-21292.07.patch
          169 kB
          Miklos Gergely
        8. HIVE-21292.08.patch
          169 kB
          Miklos Gergely
        9. HIVE-21292.09.patch
          169 kB
          Miklos Gergely
        10. HIVE-21292.10.patch
          164 kB
          Miklos Gergely
        11. HIVE-21292.11.patch
          164 kB
          Miklos Gergely
        12. HIVE-21292.12.patch
          164 kB
          Miklos Gergely
        13. HIVE-21292.13.patch
          164 kB
          Miklos Gergely
        14. HIVE-21292.14.patch
          164 kB
          Miklos Gergely
        15. HIVE-21292.15.patch
          164 kB
          Miklos Gergely
        16. HIVE-21292.15.patch
          164 kB
          Miklos Gergely
        17. HIVE-21292.16.patch
          164 kB
          Miklos Gergely
        18. HIVE-21292.17.patch
          164 kB
          Miklos Gergely

        Issue Links

          Activity

            People

              mgergely Miklos Gergely
              mgergely Miklos Gergely
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 8h
                  8h