Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3294

DAG.createDag() does not clear local state on repeat calls

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.2, 0.9.0, 0.8.4
    • None
    • None

    Description

      Retry of submitDAG calls, on the same DAG object, when there are errors can cause IllegalArgumentException.

      2016-04-24 00:33:40,885 ERROR [HiveServer2-Background-Pool: Thread-74]: exec.Task (TezTask.java:execute(212)) - Failed to execute tez graph.
      java.lang.IllegalArgumentException: size of topologicalVertexStack is:3 while size of vertices is:2, make sure they are the same in order to sort the vertices
      	at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
      	at org.apache.tez.dag.api.DAG.createDag(DAG.java:761)
      	at org.apache.tez.client.TezClientUtils.prepareAndCreateDAGPlan(TezClientUtils.java:694)
      	at org.apache.tez.client.TezClient.submitDAGSession(TezClient.java:508)
      	at org.apache.tez.client.TezClient.submitDAG(TezClient.java:454)
      	at org.apache.hadoop.hive.ql.exec.tez.TezTask.submit(TezTask.java:457)
      	at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:180)
      

      Attachments

        1. TEZ-3294-branch-0.7.1.patch
          8 kB
          Harish JP
        2. TEZ-3294.2.patch
          8 kB
          Harish JP
        3. TEZ-3294.1.patch
          8 kB
          Harish JP
        4. TEZ-3294.0.patch
          6 kB
          Harish JP

        Activity

          People

            harishjp Harish JP
            harishjp Harish JP
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: