Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1446

Move the fetch code for local disk fetch from data movement event handlers to fetcher

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.5.0
    • Component/s: None
    • Labels:
      None

      Description

      doing the fetch in the EventHandler has the drawback of tying up the EventHandling thread, in case it takes time to read the Index file. Even, for a healthy disk - we can do without any delays on this thread, so that the fetcher have some work to do.
      Also Need to add Unit test cases for the local fetch.

        Attachments

        1. TEZ-1446.3.patch
          96 kB
          Prakash Ramachandran
        2. TEZ-1446.2.patch
          87 kB
          Prakash Ramachandran
        3. TEZ-1446.1.patch
          71 kB
          Prakash Ramachandran

          Activity

            People

            • Assignee:
              pramachandran Prakash Ramachandran
              Reporter:
              pramachandran Prakash Ramachandran
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: