Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5286

DFS client blocked for a long time reading blocks of a file on the JobTracker

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 0.20.0
    • None
    • None
    • None

    Description

      On a large cluster, we've observed that DFS client was blocked on reading a block of a file for almost 1 and half hours. The file was being read by the JobTracker of the cluster, and was a split file of a job. On the NameNode logs, we observed that the block had a message as follows:

      Inconsistent size for block blk_2044238107768440002_840946 reported from <ip>:<port> current size is 195072 reported size is 1318567

      Details follow.

      Attachments

        1. dn-log.txt
          3.79 MB
          Raghu Angadi
        2. jt-log-for-blocked-reads.txt
          7 kB
          Hemanth Yamijala

        Issue Links

          Activity

            People

              Unassigned Unassigned
              yhemanth Hemanth Yamijala
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: