Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6988 Hive changes for tez-0.5.x compatibility
  3. HIVE-7204

Use NULL vertex location hint for Prewarm DAG vertices

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.14.0
    • 0.14.0
    • Tez
    • None
    • Use NULL VertexLocationHint for prewarm DAG vertexes.

    Description

      The current 0.5.x branch of Tez added extra preconditions which check for parallelism settings to match between the number of containers and the vertex location hints.

      Caused by: org.apache.hadoop.ipc.RemoteException(java.lang.IllegalArgumentException): Locations array length must match the parallelism set for the vertex
              at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
              at org.apache.tez.dag.api.Vertex.setTaskLocationsHint(Vertex.java:105)
              at org.apache.tez.dag.app.DAGAppMaster.startPreWarmContainers(DAGAppMaster.java:1004)
      

      Attachments

        1. HIVE-7204.1.patch
          0.7 kB
          Gopal Vijayaraghavan

        Activity

          People

            gopalv Gopal Vijayaraghavan
            gopalv Gopal Vijayaraghavan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: