Hive
  1. Hive
  2. HIVE-3724

Metastore tests use hardcoded ports

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.10.0
    • Component/s: Tests
    • Labels:
      None

      Description

      Several of the metastore tests use hardcoded ports for remote metastore Thrift servers. This is causing transient failures in Jenkins, e.g. https://builds.apache.org/job/Hive-trunk-h0.21/1804/

      A few tests already dynamically determine free ports, and this logic can be shared.

      1. HIVE-3724.1.patch.txt
        11 kB
        Kevin Wilfong
      2. HIVE-3724.2.patch.txt
        13 kB
        Kevin Wilfong
      3. hive-3724.svn-0.10.patch
        13 kB
        Sushanth Sowmyan

        Activity

        Kevin Wilfong created issue -
        Show
        Kevin Wilfong added a comment - https://reviews.facebook.net/D6825
        Kevin Wilfong made changes -
        Field Original Value New Value
        Attachment HIVE-3724.1.patch.txt [ 12554256 ]
        Kevin Wilfong made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Ashutosh Chauhan added a comment -

        We can reuse MetaStoreUtils::startMetaStore() for some of this refactoring which has a nice property of not waiting for fixed amount of time. See, its usage in TestMetaStoreAuthorization::testMetaStoreAuthorization.

        Show
        Ashutosh Chauhan added a comment - We can reuse MetaStoreUtils::startMetaStore() for some of this refactoring which has a nice property of not waiting for fixed amount of time. See, its usage in TestMetaStoreAuthorization::testMetaStoreAuthorization.
        Ashutosh Chauhan made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Kevin Wilfong made changes -
        Attachment HIVE-3724.2.patch.txt [ 12555433 ]
        Kevin Wilfong made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Kevin Wilfong added a comment -

        Thanks Ashutosh, switched to using that method in the refactored tests, and deleted the duplicate method.

        Show
        Kevin Wilfong added a comment - Thanks Ashutosh, switched to using that method in the refactored tests, and deleted the duplicate method.
        Hide
        Ashutosh Chauhan added a comment -

        +1

        Show
        Ashutosh Chauhan added a comment - +1
        Hide
        Mark Grover added a comment -

        +1 (non-committer)

        Show
        Mark Grover added a comment - +1 (non-committer)
        Hide
        Ashutosh Chauhan added a comment -

        Committed to trunk. Thanks, Kevin!

        Show
        Ashutosh Chauhan added a comment - Committed to trunk. Thanks, Kevin!
        Ashutosh Chauhan made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.11 [ 12323587 ]
        Resolution Fixed [ 1 ]
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21 #1828 (See https://builds.apache.org/job/Hive-trunk-h0.21/1828/)
        HIVE-3724 : Metastore tests use hardcoded ports (Kevin Wilfong via Ashutosh Chauhan) (Revision 1415917)

        Result = FAILURE
        hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1415917
        Files :

        • /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEndFunctionListener.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStore.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStoreIpAddress.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestSetUGIOnOnlyClient.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestSetUGIOnOnlyServer.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21 #1828 (See https://builds.apache.org/job/Hive-trunk-h0.21/1828/ ) HIVE-3724 : Metastore tests use hardcoded ports (Kevin Wilfong via Ashutosh Chauhan) (Revision 1415917) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1415917 Files : /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEndFunctionListener.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStore.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStoreIpAddress.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestSetUGIOnOnlyClient.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestSetUGIOnOnlyServer.java
        Hide
        Sushanth Sowmyan added a comment -

        Adding 0.10 version of the patch.

        Show
        Sushanth Sowmyan added a comment - Adding 0.10 version of the patch.
        Sushanth Sowmyan made changes -
        Attachment hive-3724.svn-0.10.patch [ 12560174 ]
        Ashutosh Chauhan made changes -
        Fix Version/s 0.10.0 [ 12320745 ]
        Fix Version/s 0.11 [ 12323587 ]
        Hide
        Ashutosh Chauhan added a comment -

        Committed to 0.10 branch. Thanks, Sushanth for backport!

        Show
        Ashutosh Chauhan added a comment - Committed to 0.10 branch. Thanks, Sushanth for backport!
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/)
        HIVE-3724 : Metastore tests use hardcoded ports (Kevin Wilfong via Ashutosh Chauhan) (Revision 1415917)

        Result = ABORTED
        hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1415917
        Files :

        • /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEndFunctionListener.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStore.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStoreIpAddress.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestSetUGIOnOnlyClient.java
        • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestSetUGIOnOnlyServer.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/ ) HIVE-3724 : Metastore tests use hardcoded ports (Kevin Wilfong via Ashutosh Chauhan) (Revision 1415917) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1415917 Files : /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEndFunctionListener.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStore.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStoreIpAddress.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestSetUGIOnOnlyClient.java /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestSetUGIOnOnlyServer.java
        Hide
        Ashutosh Chauhan added a comment -

        This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

        Show
        Ashutosh Chauhan added a comment - This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.
        Ashutosh Chauhan made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Patch Available Patch Available Open Open
        1d 11h 13m 1 Ashutosh Chauhan 29/Nov/12 09:10
        Open Open Patch Available Patch Available
        8d 13h 8m 2 Kevin Wilfong 29/Nov/12 23:37
        Patch Available Patch Available Resolved Resolved
        1d 5h 19m 1 Ashutosh Chauhan 01/Dec/12 04:56
        Resolved Resolved Closed Closed
        40d 14h 56m 1 Ashutosh Chauhan 10/Jan/13 19:53

          People

          • Assignee:
            Kevin Wilfong
            Reporter:
            Kevin Wilfong
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development