Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-11762

[SPS] : Empty files should be ignored in StoragePolicySatisfier.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-10285
    • HDFS-10285, 3.2.0
    • namenode
    • None

    Description

      File which has zero block should be ignored in SPS. Currently it is throwing NPE in StoragePolicySatisfier thread.

      2017-05-06 23:29:04,735 [StoragePolicySatisfier] ERROR namenode.StoragePolicySatisfier (StoragePolicySatisfier.java:run(278)) - StoragePolicySatisfier thread received runtime exception. Stopping Storage policy satisfier work
      java.lang.NullPointerException
      	at org.apache.hadoop.hdfs.server.namenode.StoragePolicySatisfier.analyseBlocksStorageMovementsAndAssignToDN(StoragePolicySatisfier.java:292)
      	at org.apache.hadoop.hdfs.server.namenode.StoragePolicySatisfier.run(StoragePolicySatisfier.java:233)
      	at java.lang.Thread.run(Thread.java:745)
      

      Attachments

        1. HDFS-11762-HDFS-10285.004.patch
          4 kB
          Surendra Singh Lilhore
        2. HDFS-11762-HDFS-10285.003.patch
          4 kB
          Surendra Singh Lilhore
        3. HDFS-11762-HDFS-10285.002.patch
          4 kB
          Surendra Singh Lilhore
        4. HDFS-11762-HDFS-10285.001.patch
          3 kB
          Surendra Singh Lilhore

        Activity

          People

            surendralilhore Surendra Singh Lilhore
            surendralilhore Surendra Singh Lilhore
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: