Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-896

Users can set non-writable permissions on temporary files for TT and can abuse disk usage.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.21.0
    • 0.21.0
    • tasktracker
    • None
    • Reviewed

    Description

      As of now, irrespective of the TaskController in use, TT itself does a full delete on local files created by itself or job tasks. This step, depending upon TT's umask and the permissions set by files by the user, for e.g in job-work/task-work or child.tmp directories, may or may not go through successful completion fully. Thus is left an opportunity for abusing disk space usage either accidentally or intentionally by TT/users.

      Attachments

        1. y896.v2.patch
          53 kB
          Ravi Gummadi
        2. y896.v2.1.patch
          53 kB
          Ravi Gummadi
        3. y896.v2.1.fix.v2.patch
          8 kB
          Ravi Gummadi
        4. y896.v2.1.fix.v1.patch
          8 kB
          Ravi Gummadi
        5. y896.v2.1.fix.patch
          6 kB
          Ravi Gummadi
        6. y896.v1.patch
          48 kB
          Ravi Gummadi
        7. MR-896.v8-y20.patch
          62 kB
          Hemanth Yamijala
        8. MR-896.v8.patch
          60 kB
          Hemanth Yamijala
        9. MR-896.v7.patch
          60 kB
          Ravi Gummadi
        10. MR-896.v6.patch
          53 kB
          Hemanth Yamijala
        11. MR-896.v5.patch
          56 kB
          Hemanth Yamijala
        12. MR-896.v4.patch
          56 kB
          Hemanth Yamijala
        13. MR-896.v3.patch
          56 kB
          Ravi Gummadi
        14. MR-896.v2.patch
          49 kB
          Ravi Gummadi
        15. MR-896.v1.patch
          27 kB
          Ravi Gummadi
        16. MR-896.patch
          27 kB
          Ravi Gummadi

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-1284 TestLocalizationWithLinuxTaskController fails

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-1422 Changing permissions of files/dirs under job-work-dir may be needed sothat cleaning up of job-dir in all mapred-local-directories succeeds always

          • Major - Major loss of function.
          • Closed

          Activity

            People

              ravidotg Ravi Gummadi
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: