Hive
  1. Hive
  2. HIVE-1175

Enable automatic patch testing on Hudson

    Details

    • Type: Task Task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Build Infrastructure
    • Labels:

      Activity

      Transition Time In Source Status Execution Times Last Executer Last Execution Date
      Open Open Resolved Resolved
      1664d 3h 33m 1 Lars Francke 08/Sep/14 09:39
      Lars Francke made changes -
      Field Original Value New Value
      Resolution Fixed [ 1 ]
      Status Open [ 1 ] Resolved [ 5 ]
      Hide
      Lars Francke added a comment -

      The original link doesn't work anymore but from the title I assume that's already been fixed by the "Hive QA" bot.

      Show
      Lars Francke added a comment - The original link doesn't work anymore but from the title I assume that's already been fixed by the "Hive QA" bot.
      Hide
      John Sichi added a comment -

      Added Johan as watcher since I think he manages the Hudson setup.

      Show
      John Sichi added a comment - Added Johan as watcher since I think he manages the Hudson setup.
      Hide
      Carl Steinbach added a comment -

      Here's Nigel's original blog post describing the automatic patch testing setup for Hadoop: http://developer.yahoo.net/blogs/hadoop/2007/12/if_it_hurts_automate_it_1.html

      All the Jira state changes are sent to the Hadoop mailing list. A daemon on the build machine is subscribed to the mailing list and processes the mail using the processHadoopPatchEmail.sh script. The patch "queue" created by that script is administered by the Hadoop-Patch-Admin build which runs the hudsonPatchQueueAdmin.sh script every few minutes. When there is a patch to test, the Hadoop-Patch build is kicked off running the hudsonBuildHadoopPatch.sh script.

      I'm planning to adapt Pig's test-patch.sh script and their test-patch specific ant targets to Hive, but it's clear we'll need to add some new Hudson jobs similar to the ones that Pig has, e.g. Pig-Patch-Admin and Pig-Patch-h7.grid.sp2. Can someone with Hudson admin access please take a look at these jobs and try to determine whether or not it's feasible to set this up for Hive?

      Show
      Carl Steinbach added a comment - Here's Nigel's original blog post describing the automatic patch testing setup for Hadoop: http://developer.yahoo.net/blogs/hadoop/2007/12/if_it_hurts_automate_it_1.html All the Jira state changes are sent to the Hadoop mailing list. A daemon on the build machine is subscribed to the mailing list and processes the mail using the processHadoopPatchEmail.sh script. The patch "queue" created by that script is administered by the Hadoop-Patch-Admin build which runs the hudsonPatchQueueAdmin.sh script every few minutes. When there is a patch to test, the Hadoop-Patch build is kicked off running the hudsonBuildHadoopPatch.sh script. I'm planning to adapt Pig's test-patch.sh script and their test-patch specific ant targets to Hive, but it's clear we'll need to add some new Hudson jobs similar to the ones that Pig has, e.g. Pig-Patch-Admin and Pig-Patch-h7.grid.sp2 . Can someone with Hudson admin access please take a look at these jobs and try to determine whether or not it's feasible to set this up for Hive?
      Hide
      Carl Steinbach added a comment -

      The test-patch.sh script lives here: http://svn.apache.org/repos/asf/hadoop/core/nightly/test-patch

      We will need to configure svn:externals in order to get this pull in as part of hive trunk.

      Something like this:

      Check out hive trunk
      cd <hive-trunk>
      export EDITOR=emacs
      svn propedit svn:externals testutils
      [ the above step will open up the emacs. Type in the following line and save it]
      test-patch http://svn.apache.org/repos/asf/hadoop/nightly/test-patch
      svn commit

      Show
      Carl Steinbach added a comment - The test-patch.sh script lives here: http://svn.apache.org/repos/asf/hadoop/core/nightly/test-patch We will need to configure svn:externals in order to get this pull in as part of hive trunk. Something like this: Check out hive trunk cd <hive-trunk> export EDITOR=emacs svn propedit svn:externals testutils [ the above step will open up the emacs. Type in the following line and save it] test-patch http://svn.apache.org/repos/asf/hadoop/nightly/test-patch svn commit
      Carl Steinbach created issue -

        People

        • Assignee:
          Carl Steinbach
          Reporter:
          Carl Steinbach
        • Votes:
          0 Vote for this issue
          Watchers:
          4 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development