Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3457

Number of UnderReplicated blocks displayed in UI and Fsck report is different

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 2.0.0-alpha
    • None
    • None
    • None

    Description

      Scenario:
      =========
      Write an HDFS application with the following sequence of operations
      1. Create file.
      2. Append and sync file.
      3. Delete file.
      4. Create file.
      5. Rename file.
      Run the application using 50 threads for 4 hours.
      Next Run the same application using 200 threads for the next 4 hours.
      Next Run the application using 50 threads for the next 4 hours.

      The Number of under-Replicated blocks mentioned in the UI and fsck report differs

      Fsck report for the mismatch in Number of under-Replicated blocks :
      ===================================================================
      Status: HEALTHY
      Total size: 5670200922 B
      Total dirs: 2
      Total files: 2015
      Total blocks (validated): 977 (avg. block size 5803685 B)
      Minimally replicated blocks: 977 (100.0 %)
      Over-replicated blocks: 0 (0.0 %)
      Under-replicated blocks: 94 (9.621289 %)
      Mis-replicated blocks: 0 (0.0 %)
      Default replication factor: 2
      Average block replication: 1.9037871
      Corrupt blocks: 0
      Missing replicas: 94 (5.0537634 %)
      Number of data-nodes: 3
      Number of racks: 1
      FSCK ended at Mon Mar 19 11:14:41 IST 2012 in 94 milliseconds

      The filesystem under path '/' is HEALTHY

      Have attached UI screenshot for this issue

      Attachments

        Activity

          People

            Unassigned Unassigned
            andreina J.Andreina
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: