Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6988 Hive changes for tez-0.5.x compatibility
  3. HIVE-7204

Use NULL vertex location hint for Prewarm DAG vertices

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.14.0
    • 0.14.0
    • Tez
    • None
    • Use NULL VertexLocationHint for prewarm DAG vertexes.

    Description

      The current 0.5.x branch of Tez added extra preconditions which check for parallelism settings to match between the number of containers and the vertex location hints.

      Caused by: org.apache.hadoop.ipc.RemoteException(java.lang.IllegalArgumentException): Locations array length must match the parallelism set for the vertex
              at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
              at org.apache.tez.dag.api.Vertex.setTaskLocationsHint(Vertex.java:105)
              at org.apache.tez.dag.app.DAGAppMaster.startPreWarmContainers(DAGAppMaster.java:1004)
      

      Attachments

        1. HIVE-7204.1.patch
          0.7 kB
          Gopal Vijayaraghavan

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gopalv Gopal Vijayaraghavan Assign to me
            gopalv Gopal Vijayaraghavan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment