Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1446

Move the fetch code for local disk fetch from data movement event handlers to fetcher

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.5.0
    • None
    • None

    Description

      doing the fetch in the EventHandler has the drawback of tying up the EventHandling thread, in case it takes time to read the Index file. Even, for a healthy disk - we can do without any delays on this thread, so that the fetcher have some work to do.
      Also Need to add Unit test cases for the local fetch.

      Attachments

        1. TEZ-1446.3.patch
          96 kB
          Prakash Ramachandran
        2. TEZ-1446.2.patch
          87 kB
          Prakash Ramachandran
        3. TEZ-1446.1.patch
          71 kB
          Prakash Ramachandran

        Activity

          People

            pramachandran Prakash Ramachandran
            pramachandran Prakash Ramachandran
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: