Hive
  1. Hive
  2. HIVE-2629

Make a single Hive binary work with both 0.20.x and 0.23.0

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.1, 0.9.0
    • Component/s: Shims
    • Labels:
      None
    1. ASF.LICENSE.NOT.GRANTED--HIVE-2629.D711.1.patch
      199 kB
      Phabricator
    2. ASF.LICENSE.NOT.GRANTED--HIVE-2629.D711.2.patch
      124 kB
      Phabricator
    3. HIVE-2629.patch
      198 kB
      Thomas Weise
    4. ASF.LICENSE.NOT.GRANTED--HIVE-2629.D711.3.patch
      124 kB
      Phabricator
    5. HIVE-2629.3.patch
      198 kB
      Thomas Weise
    6. HIVE-2629-InputSplitShim.patch
      2 kB
      Thomas Weise

      Issue Links

        Activity

        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/)
        HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) (Revision 1230391)
        HIVE-2629. Reverting previous commit (Revision 1229584)
        HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) (Revision 1229510)

        Result = ABORTED
        amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230391
        Files :

        • /hive/trunk/build-common.xml
        • /hive/trunk/build.properties
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/SchemaAwareCompressionInputStream.java
        • /hive/trunk/shims/build.xml
        • /hive/trunk/shims/ivy.xml
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        • /hive/trunk/shims/src/common-secure
        • /hive/trunk/shims/src/common-secure/java
        • /hive/trunk/shims/src/common-secure/java/org
        • /hive/trunk/shims/src/common-secure/java/org/apache
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java

        amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1229584
        Files :

        • /hive/trunk/README.txt
        • /hive/trunk/build-common.xml
        • /hive/trunk/build.properties
        • /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMax.java
        • /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMin.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataInputBuffer.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataOutputBuffer.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultGraphWalker.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultRuleDispatcher.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/Dispatcher.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/GraphWalker.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessor.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessorCtx.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/Rule.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/RuleRegExp.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinCond.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinType.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AggregationDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CollectDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CopyWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateFunctionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableLikeDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateViewDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DDLDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DescFunctionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DescTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DropFunctionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DropTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/Explain.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplainWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplosionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeColumnDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeConstantDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeFieldDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeGenericFuncDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeNullDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExtractDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FetchWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ForwardDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/GroupByDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinCondDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LateralViewJoinDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LimitDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadFileDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapJoinDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredLocalWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MoveWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PartitionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ReduceSinkDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/SchemaDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ScriptDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/SelectDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowFunctionsDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowPartitionsDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowTableStatusDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowTablesDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/UDTFDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/UnionDesc.java
        • /hive/trunk/serde/README.txt
        • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java
        • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/typeinfo
        • /hive/trunk/shims/build.xml
        • /hive/trunk/shims/ivy.xml
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        • /hive/trunk/shims/src/common-secure
        • /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java

        amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1229510
        Files :

        • /hive/trunk/build-common.xml
        • /hive/trunk/build.properties
        • /hive/trunk/shims/build.xml
        • /hive/trunk/shims/ivy.xml
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        • /hive/trunk/shims/src/common-secure
        • /hive/trunk/shims/src/common-secure/java
        • /hive/trunk/shims/src/common-secure/java/org
        • /hive/trunk/shims/src/common-secure/java/org/apache
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/ ) HIVE-2629 . Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) (Revision 1230391) HIVE-2629 . Reverting previous commit (Revision 1229584) HIVE-2629 . Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) (Revision 1229510) Result = ABORTED amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230391 Files : /hive/trunk/build-common.xml /hive/trunk/build.properties /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/SchemaAwareCompressionInputStream.java /hive/trunk/shims/build.xml /hive/trunk/shims/ivy.xml /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java /hive/trunk/shims/src/common-secure /hive/trunk/shims/src/common-secure/java /hive/trunk/shims/src/common-secure/java/org /hive/trunk/shims/src/common-secure/java/org/apache /hive/trunk/shims/src/common-secure/java/org/apache/hadoop /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1229584 Files : /hive/trunk/README.txt /hive/trunk/build-common.xml /hive/trunk/build.properties /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMax.java /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMin.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataInputBuffer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataOutputBuffer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultGraphWalker.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultRuleDispatcher.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/Dispatcher.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/GraphWalker.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessor.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessorCtx.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/Rule.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/RuleRegExp.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinCond.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinType.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AggregationDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CollectDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CopyWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateFunctionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableLikeDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateViewDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DDLDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DescFunctionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DescTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DropFunctionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DropTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/Explain.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplainWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplosionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeColumnDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeConstantDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeFieldDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeGenericFuncDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeNullDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExtractDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FetchWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ForwardDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/GroupByDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinCondDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LateralViewJoinDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LimitDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadFileDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapJoinDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredLocalWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MoveWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PartitionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ReduceSinkDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/SchemaDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ScriptDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/SelectDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowFunctionsDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowPartitionsDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowTableStatusDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowTablesDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/UDTFDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/UnionDesc.java /hive/trunk/serde/README.txt /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/typeinfo /hive/trunk/shims/build.xml /hive/trunk/shims/ivy.xml /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java /hive/trunk/shims/src/common-secure /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1229510 Files : /hive/trunk/build-common.xml /hive/trunk/build.properties /hive/trunk/shims/build.xml /hive/trunk/shims/ivy.xml /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java /hive/trunk/shims/src/common-secure /hive/trunk/shims/src/common-secure/java /hive/trunk/shims/src/common-secure/java/org /hive/trunk/shims/src/common-secure/java/org/apache /hive/trunk/shims/src/common-secure/java/org/apache/hadoop /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Hide
        Ashutosh Chauhan added a comment -

        This issue is closed now. It was released with the fix in 0.9.0. If there is a problem, please open a new jira and link this one with that.

        Show
        Ashutosh Chauhan added a comment - This issue is closed now. It was released with the fix in 0.9.0. If there is a problem, please open a new jira and link this one with that.
        Hide
        Hudson added a comment -

        Integrated in Hive-0.8.1-SNAPSHOT-h0.21 #166 (See https://builds.apache.org/job/Hive-0.8.1-SNAPSHOT-h0.21/166/)
        HIVE-2629. Merge -r 1230390:1230391 from trunk.

        amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1233262
        Files :

        • /hive/branches/branch-0.8-r2/build-common.xml
        • /hive/branches/branch-0.8-r2/build.properties
        • /hive/branches/branch-0.8-r2/shims/build.xml
        • /hive/branches/branch-0.8-r2/shims/ivy.xml
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/branches/branch-0.8-r2/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        • /hive/branches/branch-0.8-r2/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        • /hive/branches/branch-0.8-r2/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/shims
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/security
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/security/token
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation
        • /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/branches/branch-0.8-r2/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Show
        Hudson added a comment - Integrated in Hive-0.8.1-SNAPSHOT-h0.21 #166 (See https://builds.apache.org/job/Hive-0.8.1-SNAPSHOT-h0.21/166/ ) HIVE-2629 . Merge -r 1230390:1230391 from trunk. amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1233262 Files : /hive/branches/branch-0.8-r2/build-common.xml /hive/branches/branch-0.8-r2/build.properties /hive/branches/branch-0.8-r2/shims/build.xml /hive/branches/branch-0.8-r2/shims/ivy.xml /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/branches/branch-0.8-r2/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/branches/branch-0.8-r2/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java /hive/branches/branch-0.8-r2/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java /hive/branches/branch-0.8-r2/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java /hive/branches/branch-0.8-r2/shims/src/common-secure /hive/branches/branch-0.8-r2/shims/src/common-secure/java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/shims /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/security /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/security/token /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation /hive/branches/branch-0.8-r2/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/branches/branch-0.8-r2/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Hide
        Amareshwari Sriramadasu added a comment -

        Committed this to branch-0.8-r2.

        Show
        Amareshwari Sriramadasu added a comment - Committed this to branch-0.8-r2.
        Hide
        Amareshwari Sriramadasu added a comment -

        @Amareshwari: Are you planning to backport this to 0.8.1?

        Yes. Will do. Would like to commit HIVE-2616 before so that there are not many changes in the patch.

        Show
        Amareshwari Sriramadasu added a comment - @Amareshwari: Are you planning to backport this to 0.8.1? Yes. Will do. Would like to commit HIVE-2616 before so that there are not many changes in the patch.
        Hide
        Carl Steinbach added a comment -

        @Amareshwari: Are you planning to backport this to 0.8.1?

        Show
        Carl Steinbach added a comment - @Amareshwari: Are you planning to backport this to 0.8.1?
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21-dbg #5 (See https://builds.apache.org/job/Hive-trunk-h0.21-dbg/5/)
        HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari)

        amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230391
        Files :

        • /hive/trunk/build-common.xml
        • /hive/trunk/build.properties
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/SchemaAwareCompressionInputStream.java
        • /hive/trunk/shims/build.xml
        • /hive/trunk/shims/ivy.xml
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        • /hive/trunk/shims/src/common-secure
        • /hive/trunk/shims/src/common-secure/java
        • /hive/trunk/shims/src/common-secure/java/org
        • /hive/trunk/shims/src/common-secure/java/org/apache
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21-dbg #5 (See https://builds.apache.org/job/Hive-trunk-h0.21-dbg/5/ ) HIVE-2629 . Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230391 Files : /hive/trunk/build-common.xml /hive/trunk/build.properties /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/SchemaAwareCompressionInputStream.java /hive/trunk/shims/build.xml /hive/trunk/shims/ivy.xml /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java /hive/trunk/shims/src/common-secure /hive/trunk/shims/src/common-secure/java /hive/trunk/shims/src/common-secure/java/org /hive/trunk/shims/src/common-secure/java/org/apache /hive/trunk/shims/src/common-secure/java/org/apache/hadoop /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21-dbg #3 (See https://builds.apache.org/job/Hive-trunk-h0.21-dbg/3/)
        HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari)

        amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230391
        Files :

        • /hive/trunk/build-common.xml
        • /hive/trunk/build.properties
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/SchemaAwareCompressionInputStream.java
        • /hive/trunk/shims/build.xml
        • /hive/trunk/shims/ivy.xml
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        • /hive/trunk/shims/src/common-secure
        • /hive/trunk/shims/src/common-secure/java
        • /hive/trunk/shims/src/common-secure/java/org
        • /hive/trunk/shims/src/common-secure/java/org/apache
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21-dbg #3 (See https://builds.apache.org/job/Hive-trunk-h0.21-dbg/3/ ) HIVE-2629 . Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230391 Files : /hive/trunk/build-common.xml /hive/trunk/build.properties /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/SchemaAwareCompressionInputStream.java /hive/trunk/shims/build.xml /hive/trunk/shims/ivy.xml /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java /hive/trunk/shims/src/common-secure /hive/trunk/shims/src/common-secure/java /hive/trunk/shims/src/common-secure/java/org /hive/trunk/shims/src/common-secure/java/org/apache /hive/trunk/shims/src/common-secure/java/org/apache/hadoop /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21 #1196 (See https://builds.apache.org/job/Hive-trunk-h0.21/1196/)
        HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari)

        amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230391
        Files :

        • /hive/trunk/build-common.xml
        • /hive/trunk/build.properties
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/SchemaAwareCompressionInputStream.java
        • /hive/trunk/shims/build.xml
        • /hive/trunk/shims/ivy.xml
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        • /hive/trunk/shims/src/common-secure
        • /hive/trunk/shims/src/common-secure/java
        • /hive/trunk/shims/src/common-secure/java/org
        • /hive/trunk/shims/src/common-secure/java/org/apache
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21 #1196 (See https://builds.apache.org/job/Hive-trunk-h0.21/1196/ ) HIVE-2629 . Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230391 Files : /hive/trunk/build-common.xml /hive/trunk/build.properties /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/SchemaAwareCompressionInputStream.java /hive/trunk/shims/build.xml /hive/trunk/shims/ivy.xml /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java /hive/trunk/shims/src/common-secure /hive/trunk/shims/src/common-secure/java /hive/trunk/shims/src/common-secure/java/org /hive/trunk/shims/src/common-secure/java/org/apache /hive/trunk/shims/src/common-secure/java/org/apache/hadoop /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Hide
        Amareshwari Sriramadasu added a comment -

        Fix looks good. Ran the test suite with latest changes. Just committed this trunk. Thanks Thomas.
        Will resolve once get this committed to 0.8

        Show
        Amareshwari Sriramadasu added a comment - Fix looks good. Ran the test suite with latest changes. Just committed this trunk. Thanks Thomas. Will resolve once get this committed to 0.8
        Hide
        Thomas Weise added a comment -

        Attached additional patch resolves the array cast issue Amareshwari identified. The test case did not pass on 0.23 before and after the patch, this is only to address the additional error.

        Show
        Thomas Weise added a comment - Attached additional patch resolves the array cast issue Amareshwari identified. The test case did not pass on 0.23 before and after the patch, this is only to address the additional error.
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21 #1191 (See https://builds.apache.org/job/Hive-trunk-h0.21/1191/)
        HIVE-2629. Reverting previous commit

        amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1229584
        Files :

        • /hive/trunk/README.txt
        • /hive/trunk/build-common.xml
        • /hive/trunk/build.properties
        • /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMax.java
        • /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMin.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataInputBuffer.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataOutputBuffer.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultGraphWalker.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultRuleDispatcher.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/Dispatcher.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/GraphWalker.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessor.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessorCtx.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/Rule.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/RuleRegExp.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinCond.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinType.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AggregationDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CollectDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CopyWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateFunctionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableLikeDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateViewDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DDLDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DescFunctionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DescTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DropFunctionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DropTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/Explain.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplainWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplosionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeColumnDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeConstantDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeFieldDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeGenericFuncDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeNullDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExtractDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FetchWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ForwardDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/GroupByDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinCondDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LateralViewJoinDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LimitDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadFileDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadTableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapJoinDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredLocalWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MoveWork.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PartitionDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ReduceSinkDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/SchemaDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ScriptDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/SelectDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowFunctionsDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowPartitionsDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowTableStatusDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowTablesDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/UDTFDesc.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/UnionDesc.java
        • /hive/trunk/serde/README.txt
        • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java
        • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/typeinfo
        • /hive/trunk/shims/build.xml
        • /hive/trunk/shims/ivy.xml
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        • /hive/trunk/shims/src/common-secure
        • /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21 #1191 (See https://builds.apache.org/job/Hive-trunk-h0.21/1191/ ) HIVE-2629 . Reverting previous commit amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1229584 Files : /hive/trunk/README.txt /hive/trunk/build-common.xml /hive/trunk/build.properties /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMax.java /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMin.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataInputBuffer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataOutputBuffer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultGraphWalker.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultRuleDispatcher.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/Dispatcher.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/GraphWalker.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessor.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessorCtx.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/Rule.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/RuleRegExp.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinCond.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinType.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AggregationDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CollectDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CopyWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateFunctionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableLikeDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateViewDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DDLDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DescFunctionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DescTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DropFunctionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DropTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/Explain.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplainWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplosionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeColumnDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeConstantDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeFieldDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeGenericFuncDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeNullDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExtractDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FetchWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ForwardDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/GroupByDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinCondDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LateralViewJoinDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LimitDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadFileDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapJoinDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredLocalWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MoveWork.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PartitionDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ReduceSinkDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/SchemaDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ScriptDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/SelectDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowFunctionsDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowPartitionsDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowTableStatusDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowTablesDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/UDTFDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/UnionDesc.java /hive/trunk/serde/README.txt /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/typeinfo /hive/trunk/shims/build.xml /hive/trunk/shims/ivy.xml /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java /hive/trunk/shims/src/common-secure /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21 #1190 (See https://builds.apache.org/job/Hive-trunk-h0.21/1190/)
        HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari)

        amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1229510
        Files :

        • /hive/trunk/build-common.xml
        • /hive/trunk/build.properties
        • /hive/trunk/shims/build.xml
        • /hive/trunk/shims/ivy.xml
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        • /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        • /hive/trunk/shims/src/common-secure
        • /hive/trunk/shims/src/common-secure/java
        • /hive/trunk/shims/src/common-secure/java/org
        • /hive/trunk/shims/src/common-secure/java/org/apache
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation
        • /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        • /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21 #1190 (See https://builds.apache.org/job/Hive-trunk-h0.21/1190/ ) HIVE-2629 . Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1229510 Files : /hive/trunk/build-common.xml /hive/trunk/build.properties /hive/trunk/shims/build.xml /hive/trunk/shims/ivy.xml /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java /hive/trunk/shims/src/common-secure /hive/trunk/shims/src/common-secure/java /hive/trunk/shims/src/common-secure/java/org /hive/trunk/shims/src/common-secure/java/org/apache /hive/trunk/shims/src/common-secure/java/org/apache/hadoop /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        Hide
        Thomas Weise added a comment -

        Another run on one of our boxes completed overnight with no failures - all tests pass for 0.20.

        BUILD SUCCESSFUL
        Total time: 289 minutes 12 seconds
        [1]+ Done ant test > test.log 2>&1

        This JIRA's purpose is not to fix all unit tests for 0.23, but I had checked that not more test fail than there were already. Per previous comment, currently the head revision does not compile for 0.23, but I went back to a prior revision and it shows that the test mentioned above was broken before:

        svn --revision 1220920 up
        ant clean package test -Dtestcase=TestCliDriver -Dqfile=combine2.q -Dtest.silent=false -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23
        BUILD FAILED
        /Users/thw/java/hive/trunk2/build.xml:310: Keepgoing execution: 1 of 12 iterations failed.

        Total time: 2 minutes 47 seconds

        Can we please create a new JIRA for making broken tests on 0.23 work and resolve this one?

        Show
        Thomas Weise added a comment - Another run on one of our boxes completed overnight with no failures - all tests pass for 0.20. BUILD SUCCESSFUL Total time: 289 minutes 12 seconds [1] + Done ant test > test.log 2>&1 This JIRA's purpose is not to fix all unit tests for 0.23, but I had checked that not more test fail than there were already. Per previous comment, currently the head revision does not compile for 0.23, but I went back to a prior revision and it shows that the test mentioned above was broken before: svn --revision 1220920 up ant clean package test -Dtestcase=TestCliDriver -Dqfile=combine2.q -Dtest.silent=false -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23 BUILD FAILED /Users/thw/java/hive/trunk2/build.xml:310: Keepgoing execution: 1 of 12 iterations failed. Total time: 2 minutes 47 seconds Can we please create a new JIRA for making broken tests on 0.23 work and resolve this one?
        Hide
        Ashutosh Chauhan added a comment -

        As noted on HIVE-2686 atleast some of the test failures on trunk are due to non-determinism resulting from absence of order-by in few queries.

        Show
        Ashutosh Chauhan added a comment - As noted on HIVE-2686 atleast some of the test failures on trunk are due to non-determinism resulting from absence of order-by in few queries.
        Hide
        Thomas Weise added a comment -

        On head revision:

        ant clean package test -Dtestcase=TestCliDriver -Dqfile=combine2.q -Dtest.silent=false -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23

        Does not even compile. I remember though that some tests on 0.23 failed, before and after the patch as noted earlier. Fixing all unit tests for 0.23 is not part of this patch.

        Show
        Thomas Weise added a comment - On head revision: ant clean package test -Dtestcase=TestCliDriver -Dqfile=combine2.q -Dtest.silent=false -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23 Does not even compile. I remember though that some tests on 0.23 failed, before and after the patch as noted earlier. Fixing all unit tests for 0.23 is not part of this patch.
        Hide
        Amareshwari Sriramadasu added a comment -

        I could reproduce the failure by running
        "ant test -Dtestcase=TestCliDriver -Dqfile=combine2.q -Dtest.silent=false -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dshims.include=0.23"

        Show
        Amareshwari Sriramadasu added a comment - I could reproduce the failure by running "ant test -Dtestcase=TestCliDriver -Dqfile=combine2.q -Dtest.silent=false -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dshims.include=0.23"
        Hide
        Amareshwari Sriramadasu added a comment -

        Reverted the previous commit, as the patch broke CombineFileInputFormat changes in 23 shims.

        Jobs which use CombineFileInputFormat fail with following exception:
        java.lang.ClassCastException: [Lorg.apache.hadoop.mapred.InputSplit; cannot be cast to [Lorg.apache.hadoop.mapred.lib.CombineFileSplit;
        at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:387)
        at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:353)
        at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:387)
        at org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:472)
        at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:464)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360)
        at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
        at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:571)
        at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:432)
        at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:690)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
        Job Submission failed with exception 'java.lang.ClassCastException([Lorg.apache.hadoop.mapred.InputSplit; cannot be cast

        Looks like we need to have Hadoop20SShims.java and Hadoop23Shims.java files with proper CombineFileInputFormat changes for each version.

        Show
        Amareshwari Sriramadasu added a comment - Reverted the previous commit, as the patch broke CombineFileInputFormat changes in 23 shims. Jobs which use CombineFileInputFormat fail with following exception: java.lang.ClassCastException: [Lorg.apache.hadoop.mapred.InputSplit; cannot be cast to [Lorg.apache.hadoop.mapred.lib.CombineFileSplit; at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:387) at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:353) at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:387) at org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:472) at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:464) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360) at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159) at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:571) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:432) at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:690) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:189) Job Submission failed with exception 'java.lang.ClassCastException([Lorg.apache.hadoop.mapred.InputSplit; cannot be cast Looks like we need to have Hadoop20SShims.java and Hadoop23Shims.java files with proper CombineFileInputFormat changes for each version.
        Hide
        Amareshwari Sriramadasu added a comment -

        The failing tests passed on a different machine, except insert2_overwrite_partitions.q and ppr_pushdown.q. The tests failed on the trunk as well.

        I just committed the patch to trunk. Will resolve the issue once it is committed to 0.8.1.
        Thanks Thomas!

        Show
        Amareshwari Sriramadasu added a comment - The failing tests passed on a different machine, except insert2_overwrite_partitions.q and ppr_pushdown.q. The tests failed on the trunk as well. I just committed the patch to trunk. Will resolve the issue once it is committed to 0.8.1. Thanks Thomas!
        Hide
        Thomas Weise added a comment -

        I had run the tests successfully when I first submitted the patch. I did so again today on two different machines. There was one failure in each run (in different test case) which each passed on the other machine as well as on re-run on the same machine.

        Show
        Thomas Weise added a comment - I had run the tests successfully when I first submitted the patch. I did so again today on two different machines. There was one failure in each run (in different test case) which each passed on the other machine as well as on re-run on the same machine.
        Hide
        Amareshwari Sriramadasu added a comment -

        The following tests failed in my run (ant package test):

        split_sample.q
        smb_mapjoin_7.q
        smb_mapjoin_6.q
        rcfile_merge2.q
        rcfile_merge1.q
        ppr_pushdown.q
        merge_dynamic_partition3.q
        merge_dynamic_partition.q
        insert2_overwrite_partitions.q

        TestHWIServer

        Show
        Amareshwari Sriramadasu added a comment - The following tests failed in my run (ant package test): split_sample.q smb_mapjoin_7.q smb_mapjoin_6.q rcfile_merge2.q rcfile_merge1.q ppr_pushdown.q merge_dynamic_partition3.q merge_dynamic_partition.q insert2_overwrite_partitions.q TestHWIServer
        Hide
        Amareshwari Sriramadasu added a comment -

        Would like to commit this to 0.8.1 as well. Any objections?

        Thomas, Can you upload a patch for branch 0.8 (branch-0.8-r2) as well?

        Show
        Amareshwari Sriramadasu added a comment - Would like to commit this to 0.8.1 as well. Any objections? Thomas, Can you upload a patch for branch 0.8 (branch-0.8-r2) as well?
        Hide
        Phabricator added a comment -

        amareshwarisr has accepted the revision "HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0".

        +1 Changes look good.
        Could run ant package successfully on a linux box.

        Will run tests with HIVE-2629.3.patch. Will commit once they pass.

        REVISION DETAIL
        https://reviews.facebook.net/D711

        Show
        Phabricator added a comment - amareshwarisr has accepted the revision " HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0". +1 Changes look good. Could run ant package successfully on a linux box. Will run tests with HIVE-2629 .3.patch. Will commit once they pass. REVISION DETAIL https://reviews.facebook.net/D711
        Hide
        Phabricator added a comment -

        thw has commented on the revision "HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0".

        Run

        ant clean package

        on 3 different machines with no out of memory issues. This is with ant 1.8.2

        REVISION DETAIL
        https://reviews.facebook.net/D711

        Show
        Phabricator added a comment - thw has commented on the revision " HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0". Run ant clean package on 3 different machines with no out of memory issues. This is with ant 1.8.2 REVISION DETAIL https://reviews.facebook.net/D711
        Hide
        Thomas Weise added a comment -

        svn diff --show-copies-as-adds > HIVE-2629.3.patch

        (Apply using svn patch (svn 1.7) to preserve svn add/delete)

        Show
        Thomas Weise added a comment - svn diff --show-copies-as-adds > HIVE-2629 .3.patch (Apply using svn patch (svn 1.7) to preserve svn add/delete)
        Hide
        Phabricator added a comment -

        thw updated the revision "HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0".
        Reviewers: JIRA, cwsteinbach, ashutoshc

        Updated patch per Amareshwari's review.

        REVISION DETAIL
        https://reviews.facebook.net/D711

        AFFECTED FILES
        shims/ivy.xml
        shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        shims/src/common-secure
        shims/src/common-secure/java
        shims/src/common-secure/java/org
        shims/src/common-secure/java/org/apache
        shims/src/common-secure/java/org/apache/hadoop
        shims/src/common-secure/java/org/apache/hadoop/security
        shims/src/common-secure/java/org/apache/hadoop/security/token
        shims/src/common-secure/java/org/apache/hadoop/security/token/delegation
        shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        shims/src/common-secure/java/org/apache/hadoop/hive
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client
        shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        shims/src/common-secure/java/org/apache/hadoop/hive/shims
        shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        shims/build.xml
        build.properties
        build-common.xml
        shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java@1228464
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java@1228464
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java@1228464
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java@1228464
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java@1228464
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java@1228464
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java@1228464
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java@1228464
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java@1228464
        shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java@1228464

        Show
        Phabricator added a comment - thw updated the revision " HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0". Reviewers: JIRA, cwsteinbach, ashutoshc Updated patch per Amareshwari's review. REVISION DETAIL https://reviews.facebook.net/D711 AFFECTED FILES shims/ivy.xml shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java shims/src/common-secure shims/src/common-secure/java shims/src/common-secure/java/org shims/src/common-secure/java/org/apache shims/src/common-secure/java/org/apache/hadoop shims/src/common-secure/java/org/apache/hadoop/security shims/src/common-secure/java/org/apache/hadoop/security/token shims/src/common-secure/java/org/apache/hadoop/security/token/delegation shims/src/common-secure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java shims/src/common-secure/java/org/apache/hadoop/hive shims/src/common-secure/java/org/apache/hadoop/hive/thrift shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client shims/src/common-secure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java shims/src/common-secure/java/org/apache/hadoop/hive/shims shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java shims/build.xml build.properties build-common.xml shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java@1228464 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java@1228464 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java@1228464 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java@1228464 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java@1228464 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java@1228464 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java@1228464 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java@1228464 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java@1228464 shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java@1228464
        Hide
        Phabricator added a comment -

        thw has commented on the revision "HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0".

        Updated patch will rename directory to common-secure

        INLINE COMMENTS
        shims/build.xml:62 Looks like this was done to support pre 0.20?
        Since the classes have been moved to common in HIVE-2468 and they go into the shim jar anyways, there should be no need for this.

        https://issues.apache.org/jira/browse/HIVE-1408?focusedCommentId=12888867&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-12888867

        shims/build.xml:57 Done.
        build.properties:13-17 There will be one default Hadoop version per shim implementation and that is needed to build all shims (the desired default behavior). The user does not have to change these for the default build but has the flexibility to do so via command line override (for example when wanting to experiment with other Hadoop versions for existing shims).

        In addition, external builds like HCatalog can read the property file to reference the Hadoop location.
        build-common.xml:118-123 Results of ivy:retrieve are immutable and therefore the identifier has to be unique for the Hadoop version to compile against multiple versions in a single ant run.

        REVISION DETAIL
        https://reviews.facebook.net/D711

        Show
        Phabricator added a comment - thw has commented on the revision " HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0". Updated patch will rename directory to common-secure INLINE COMMENTS shims/build.xml:62 Looks like this was done to support pre 0.20? Since the classes have been moved to common in HIVE-2468 and they go into the shim jar anyways, there should be no need for this. https://issues.apache.org/jira/browse/HIVE-1408?focusedCommentId=12888867&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-12888867 shims/build.xml:57 Done. build.properties:13-17 There will be one default Hadoop version per shim implementation and that is needed to build all shims (the desired default behavior). The user does not have to change these for the default build but has the flexibility to do so via command line override (for example when wanting to experiment with other Hadoop versions for existing shims). In addition, external builds like HCatalog can read the property file to reference the Hadoop location. build-common.xml:118-123 Results of ivy:retrieve are immutable and therefore the identifier has to be unique for the Hadoop version to compile against multiple versions in a single ant run. REVISION DETAIL https://reviews.facebook.net/D711
        Hide
        Phabricator added a comment -

        amareshwarisr has commented on the revision "HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0".

        I realize that it is not possible to keep all the files in common itself. The suggestion is to rename commonSecure to common-secure, as the former name does not fit into the directory name style.

        Also, I could not run 'ant package' after applying the patch, as it was failing with Out of memory issues.

        INLINE COMMENTS
        shims/build.xml:62 Earlier shim builds exclude Proxy*.java files and include them separately in compile. Not sure why it is done so. But this patch removes the functionality. When I dig through svn history, it is done by HIVE-1408 to make hive automatically run in local mode. Not sure if it is still required. anyone aware this?

        REVISION DETAIL
        https://reviews.facebook.net/D711

        Show
        Phabricator added a comment - amareshwarisr has commented on the revision " HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0". I realize that it is not possible to keep all the files in common itself. The suggestion is to rename commonSecure to common-secure, as the former name does not fit into the directory name style. Also, I could not run 'ant package' after applying the patch, as it was failing with Out of memory issues. INLINE COMMENTS shims/build.xml:62 Earlier shim builds exclude Proxy*.java files and include them separately in compile. Not sure why it is done so. But this patch removes the functionality. When I dig through svn history, it is done by HIVE-1408 to make hive automatically run in local mode. Not sure if it is still required. anyone aware this? REVISION DETAIL https://reviews.facebook.net/D711
        Hide
        Phabricator added a comment -

        amareshwarisr has commented on the revision "HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0".

        The directory commonSecure should be changed to common/secure. Why don't we put those files in the directory common itself? Why create a new directory? Putting them in common would make the code cleaner

        INLINE COMMENTS
        build-common.xml:118-123 Why are these changes required? If not required, can you remove them?
        build.properties:13-17 Are we going to add new version here for all the upcoming versions as well? I don't think we should do it this way.
        shims/build.xml:57 Can we change commonSecure to common.secure in all the places?

        REVISION DETAIL
        https://reviews.facebook.net/D711

        Show
        Phabricator added a comment - amareshwarisr has commented on the revision " HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0". The directory commonSecure should be changed to common/secure. Why don't we put those files in the directory common itself? Why create a new directory? Putting them in common would make the code cleaner INLINE COMMENTS build-common.xml:118-123 Why are these changes required? If not required, can you remove them? build.properties:13-17 Are we going to add new version here for all the upcoming versions as well? I don't think we should do it this way. shims/build.xml:57 Can we change commonSecure to common.secure in all the places? REVISION DETAIL https://reviews.facebook.net/D711
        Hide
        Thomas Weise added a comment -

        Attached patch was generated using svn client 1.7 to represent moved files as adds:

        svn diff --show-copies-as-adds > HIVE-2629.patch

        Show
        Thomas Weise added a comment - Attached patch was generated using svn client 1.7 to represent moved files as adds: svn diff --show-copies-as-adds > HIVE-2629 .patch
        Hide
        Thomas Weise added a comment -

        Uploading patch manually for Ashutosh to get past Phabricator issue.

        Show
        Thomas Weise added a comment - Uploading patch manually for Ashutosh to get past Phabricator issue.
        Hide
        Ashutosh Chauhan added a comment -

        How do I apply the latest patch. I tried following:
        a) $ arc patch D711
        ARC: Cannot mix P and A
        UNIX: No such file or directory

        b) curl https://issues.apache.org/jira/secure/attachment/12508908/HIVE-2629.D711.2.patch | patch -p0
        that didnt work either.

        Note that I didnt apply any of the previous patches for this issue. Looks like I need to do that to apply latest patch. But I have same issue even there. Also, on phabricator UI I want to see the diff between current trunk and latest patch, but it is showing me the diff between current patch and previous patch

        Show
        Ashutosh Chauhan added a comment - How do I apply the latest patch. I tried following: a) $ arc patch D711 ARC: Cannot mix P and A UNIX: No such file or directory b) curl https://issues.apache.org/jira/secure/attachment/12508908/HIVE-2629.D711.2.patch | patch -p0 that didnt work either. Note that I didnt apply any of the previous patches for this issue. Looks like I need to do that to apply latest patch. But I have same issue even there. Also, on phabricator UI I want to see the diff between current trunk and latest patch, but it is showing me the diff between current patch and previous patch
        Hide
        Phabricator added a comment -

        thw updated the revision "HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0".
        Reviewers: JIRA, cwsteinbach

        Rebased patch.

        REVISION DETAIL
        https://reviews.facebook.net/D711

        AFFECTED FILES
        shims/ivy.xml
        shims/src/commonSecure
        shims/src/commonSecure/java
        shims/src/commonSecure/java/org
        shims/src/commonSecure/java/org/apache
        shims/src/commonSecure/java/org/apache/hadoop
        shims/src/commonSecure/java/org/apache/hadoop/security
        shims/src/commonSecure/java/org/apache/hadoop/security/token
        shims/src/commonSecure/java/org/apache/hadoop/security/token/delegation
        shims/src/commonSecure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        shims/src/commonSecure/java/org/apache/hadoop/hive
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/client
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/shims
        shims/src/commonSecure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java
        shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        shims/build.xml
        build.properties
        build-common.xml
        shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java@1225709
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java@1225709
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java@1225709
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java@1225709
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java@1225709
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java@1225709
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java@1225709
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java@1225709
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java@1225709
        shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java@1225705

        Show
        Phabricator added a comment - thw updated the revision " HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0". Reviewers: JIRA, cwsteinbach Rebased patch. REVISION DETAIL https://reviews.facebook.net/D711 AFFECTED FILES shims/ivy.xml shims/src/commonSecure shims/src/commonSecure/java shims/src/commonSecure/java/org shims/src/commonSecure/java/org/apache shims/src/commonSecure/java/org/apache/hadoop shims/src/commonSecure/java/org/apache/hadoop/security shims/src/commonSecure/java/org/apache/hadoop/security/token shims/src/commonSecure/java/org/apache/hadoop/security/token/delegation shims/src/commonSecure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java shims/src/commonSecure/java/org/apache/hadoop/hive shims/src/commonSecure/java/org/apache/hadoop/hive/thrift shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/client shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java shims/src/commonSecure/java/org/apache/hadoop/hive/shims shims/src/commonSecure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java shims/build.xml build.properties build-common.xml shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java@1225709 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java@1225709 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java@1225709 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java@1225709 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java@1225709 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java@1225709 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java@1225709 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java@1225709 shims/src/0.20S/java/org/apache/hadoop/hive/thrift/client/TUGIAssumingTransport.java@1225709 shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java@1225705
        Hide
        Thomas Weise added a comment -

        bump

        Show
        Thomas Weise added a comment - bump
        Hide
        Ted Yu added a comment -
        public abstract class HadoopShimsSecure implements HadoopShims {
        

        Accommodating hadoop 0.22 would be slightly more complex since it doesn't currently support security.

        Show
        Ted Yu added a comment - public abstract class HadoopShimsSecure implements HadoopShims { Accommodating hadoop 0.22 would be slightly more complex since it doesn't currently support security.
        Hide
        Ted Yu added a comment -

        Is it possible to support hadoop 0.22 which was released recently ?

        Show
        Ted Yu added a comment - Is it possible to support hadoop 0.22 which was released recently ?
        Show
        Thomas Weise added a comment - https://reviews.facebook.net/D711
        Hide
        Ashutosh Chauhan added a comment -

        @Thomas,
        I will take a look at it in couple of days.

        Show
        Ashutosh Chauhan added a comment - @Thomas, I will take a look at it in couple of days.
        Hide
        Thomas Weise added a comment -

        As indicated, unit tests pass (or status unchanged with respect to 0.23). Review/comments anyone?

        Show
        Thomas Weise added a comment - As indicated, unit tests pass (or status unchanged with respect to 0.23). Review/comments anyone?
        Hide
        Thomas Weise added a comment -

        Unit test results:

        ant package test

        All tests pass for default hadoop versions.

        ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dshims.include=0.23 clean package test testreport

        86% tests pass. Same result as current trunk, tests run with:

        ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23 package test testreport

        Show
        Thomas Weise added a comment - Unit test results: ant package test All tests pass for default hadoop versions. ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dshims.include=0.23 clean package test testreport 86% tests pass. Same result as current trunk, tests run with: ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23 package test testreport
        Hide
        Phabricator added a comment -

        thw requested code review of "HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0".
        Reviewers: JIRA

        Changes to compile all shims into single jar against respective hadoop version(s). Shims to be included and hadoop version used to compile common code can be specified on command line, with all shims included by default.
        Example that only uses 0.23: ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dshims.include=0.23 clean package test-shims

        Common code for 0.20 secure and 0.23 has been moved to separate source directory.

        Currently running tests.

        TEST PLAN
        EMPTY

        REVISION DETAIL
        https://reviews.facebook.net/D711

        AFFECTED FILES
        shims/ivy.xml
        shims/src/commonSecure
        shims/src/commonSecure/java
        shims/src/commonSecure/java/org
        shims/src/commonSecure/java/org/apache
        shims/src/commonSecure/java/org/apache/hadoop
        shims/src/commonSecure/java/org/apache/hadoop/security
        shims/src/commonSecure/java/org/apache/hadoop/security/token
        shims/src/commonSecure/java/org/apache/hadoop/security/token/delegation
        shims/src/commonSecure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        shims/src/commonSecure/java/org/apache/hadoop/hive
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        shims/src/commonSecure/java/org/apache/hadoop/hive/shims
        shims/src/commonSecure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
        shims/src/0.20S/java/org/apache/hadoop/security
        shims/src/0.20S/java/org/apache/hadoop/security/token
        shims/src/0.20S/java/org/apache/hadoop/security/token/delegation
        shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java
        shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java
        shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
        shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java
        shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java
        shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
        shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java
        shims/build.xml
        build.properties
        build-common.xml

        MANAGE HERALD DIFFERENTIAL RULES
        https://reviews.facebook.net/herald/view/differential/

        WHY DID I GET THIS EMAIL?
        https://reviews.facebook.net/herald/transcript/1557/

        Tip: use the X-Herald-Rules header to filter Herald messages in your client.

        Show
        Phabricator added a comment - thw requested code review of " HIVE-2629 [jira] Make a single Hive binary work with both 0.20.x and 0.23.0". Reviewers: JIRA Changes to compile all shims into single jar against respective hadoop version(s). Shims to be included and hadoop version used to compile common code can be specified on command line, with all shims included by default. Example that only uses 0.23: ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dshims.include=0.23 clean package test-shims Common code for 0.20 secure and 0.23 has been moved to separate source directory. Currently running tests. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D711 AFFECTED FILES shims/ivy.xml shims/src/commonSecure shims/src/commonSecure/java shims/src/commonSecure/java/org shims/src/commonSecure/java/org/apache shims/src/commonSecure/java/org/apache/hadoop shims/src/commonSecure/java/org/apache/hadoop/security shims/src/commonSecure/java/org/apache/hadoop/security/token shims/src/commonSecure/java/org/apache/hadoop/security/token/delegation shims/src/commonSecure/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java shims/src/commonSecure/java/org/apache/hadoop/hive shims/src/commonSecure/java/org/apache/hadoop/hive/thrift shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java shims/src/commonSecure/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java shims/src/commonSecure/java/org/apache/hadoop/hive/shims shims/src/commonSecure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java shims/src/0.20S/java/org/apache/hadoop/security shims/src/0.20S/java/org/apache/hadoop/security/token shims/src/0.20S/java/org/apache/hadoop/security/token/delegation shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSecretManager.java shims/src/0.20S/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector.java shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java shims/build.xml build.properties build-common.xml MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/1557/ Tip: use the X-Herald-Rules header to filter Herald messages in your client.
        Hide
        Carl Steinbach added a comment -

        Do we want all 3 shims to be compiled as part of the build?

        Yes, I support doing it this way.

        Show
        Carl Steinbach added a comment - Do we want all 3 shims to be compiled as part of the build? Yes, I support doing it this way.
        Hide
        Thomas Weise added a comment -

        Looking at this in the context of HCATALOG-179. As of now 0.23 shim is incomplete (does not support security, authentication code is not included). I'm looking into restructuring the secure shim code so that 20S and 23 share common code and only redefine what is unique to 20S vs. 23. Do we want all 3 shims to be compiled as part of the build?

        Show
        Thomas Weise added a comment - Looking at this in the context of HCATALOG-179 . As of now 0.23 shim is incomplete (does not support security, authentication code is not included). I'm looking into restructuring the secure shim code so that 20S and 23 share common code and only redefine what is unique to 20S vs. 23. Do we want all 3 shims to be compiled as part of the build?
        Show
        Carl Steinbach added a comment - Relevant comment from HIVE-2468 : https://issues.apache.org/jira/browse/HIVE-2468?focusedCommentId=13163313&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13163313

          People

          • Assignee:
            Thomas Weise
            Reporter:
            Carl Steinbach
          • Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development