1. Hive
  2. HIVE-4304

Remove unused builtins and pdk submodules


    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: None
    • Labels:


      Moving from email. The builtins and pdk submodules are not believed to be in use and should be removed. The main benefits are simplification and maintainability of the Hive code base.

      Forwarded conversation
      Subject: builtins submodule - is it still needed?

      From: Travis Crawford <>
      Date: Thu, Apr 4, 2013 at 2:01 PM

      Hey hive gurus -

      Is the "builtins" hive submodule in use? The submodule was added in
      HIVE-2523 as a location for builtin-UDFs, but it appears to not have
      taken off. Any objections to removing it?


      For HIVE-4278 I'm making some build changes for the HCatalog
      integration. The "builtins" submodule causes issues because it delays
      building until the packaging phase - so HCatalog can't depend on
      builtins, which it does transitively.

      While investigating a path forward I discovered the "builtins"
      submodule contains very little code, and likely could either go away
      entirely or merge into "ql", simplifying things both for users and

      Thoughts? Can anyone with context help me understand "builtins", both
      in general and around its non-standard build? For your trouble I'll
      either make the submodule go away/merge into another submodule, or
      update the docs with what we learn.


      From: Ashutosh Chauhan <>
      Date: Fri, Apr 5, 2013 at 3:10 PM
      Cc: "" <>

      I haven't used it myself anytime till now. Neither have met anyone who used
      it or plan to use it.


      On Thu, Apr 4, 2013 at 2:01 PM, Travis Crawford <>wrote:

      From: Gunther Hagleitner <>
      Date: Fri, Apr 5, 2013 at 3:11 PM


      I would actually go a step further and propose to remove both PDK and
      builtins. I've went through the code for both and here is what I found:


      • Empty file
      • UDAFUnionMap: Merges maps. Doesn't seem to be useful by itself, but was
        intended as a building block for PDK


      • some helper build.xml/test setup + teardown scripts
      • Classes/annotations to help run unit tests
      • rot13 as an example

      From what I can tell it's a fair assessment that it hasn't taken off, last
      commits to it seem to have happened more than 1.5 years ago.


      On Thu, Apr 4, 2013 at 2:01 PM, Travis Crawford <>wrote:

      From: Owen O'Malley <>
      Date: Fri, Apr 5, 2013 at 4:45 PM

      +1 to removing them.

      We have a Rot13 example in ql/src/test/org/apache/hadoop/hive/ql/io/udf/Rot13

      {In,Out} anyways. smile

      – Owen

      1. HIVE-4304.1.patch
        60 kB
        Gunther Hagleitner
      2. HIVE-4304.patch
        65 kB
        Travis Crawford

        Issue Links


          Travis Crawford created issue -
          Gunther Hagleitner made changes -
          Field Original Value New Value
          Attachment HIVE-4304.1.patch [ 12577338 ]
          Travis Crawford made changes -
          Attachment HIVE-4304.patch [ 12579555 ]
          Travis Crawford made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Ashutosh Chauhan made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.12.0 [ 12324312 ]
          Resolution Fixed [ 1 ]
          Ashutosh Chauhan made changes -
          Fix Version/s 0.11.0 [ 12323587 ]
          Fix Version/s 0.12.0 [ 12324312 ]
          Owen O'Malley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Lee Tucker made changes -
          Link This issue is related to OOZIE-1665 [ OOZIE-1665 ]


            • Assignee:
              Travis Crawford
              Travis Crawford
            • Votes:
              0 Vote for this issue
              8 Start watching this issue


              • Created: