Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2750

Shuffle may not shutdown in case of a fetch failure, causing it to hang

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.0-alpha
    • 0.8.1-alpha
    • None
    • None

    Description

      When running the Cascading tests with 0.8-alpha, they hang forever.

      git clone https://github.com/cascading/cascading
      cd cascading
      

      update cascading-hadoop2-tez/build.gradle:

      • update ext.tezVersion to '0.8.0-alpha'
      • add the staging repos to the repositories block.
       maven {url = 'https://repository.apache.org/content/repositories/orgapachetez-1040/'}
       maven {url = 'https://repository.apache.org/content/repositories/orgapachetez-1041/'}
      

      then run this:

      gradle cascading-hadoop2-tez:build -i
      

      It will hang after a while. You will have to have gradle 2.x installed on your machine. 1.x wont work.

      Attachments

        1. TEZ-2750.1.txt
          26 kB
          Siddharth Seth
        2. TEZ-2750.2.txt
          26 kB
          Siddharth Seth
        3. buildReport_tez0_7_1_SNAPSHOT.tar.gz
          4.52 MB
          Siddharth Seth

        Activity

          People

            sseth Siddharth Seth
            fs111 André Kelpe
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: