Hadoop Common
  1. Hadoop Common
  2. HADOOP-4997

workaround for tmp file handling on DataNodes in 0.18 (HADOOP-4663)

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.18.0
    • Fix Version/s: 0.18.3
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change
    • Release Note:
      Revert tmp files handling on DataNodes back to 0.17. sync() introduced in 0.18 has less gaurantees.

      Description

      This is a temporary work around issues discussed in HADOOP-4663.

      The proposal is to remove all the files under tmp directory, thus bringing the behavior back to 0.17. The main cost is that sync() will not be supported. This is incompatible with 0.18.x, but not with 0.17 because of this reason.

      1. deleteTmp-0.18.patch
        0.9 kB
        dhruba borthakur
      2. HADOOP-4997-branch-18.patch
        4 kB
        Raghu Angadi

        Issue Links

          Activity

          Raghu Angadi created issue -
          Raghu Angadi made changes -
          Field Original Value New Value
          Link This issue is part of HADOOP-4663 [ HADOOP-4663 ]
          dhruba borthakur made changes -
          Attachment deleteTmp-0.18.patch [ 12397458 ]
          Raghu Angadi made changes -
          Attachment HADOOP-4997-branch-18.patch [ 12397470 ]
          Raghu Angadi made changes -
          Assignee Raghu Angadi [ rangadi ]
          Raghu Angadi made changes -
          Assignee Raghu Angadi [ rangadi ]
          Raghu Angadi made changes -
          Resolution Fixed [ 1 ]
          Release Note Revert tmp files handling on DataNodes back to 0.17. sync() introduced in 0.18 has less gaurantees.
          Hadoop Flags [Incompatible change]
          Status Open [ 1 ] Resolved [ 5 ]
          Nigel Daley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Raghu Angadi made changes -
          Link This issue incorporates HADOOP-5225 [ HADOOP-5225 ]
          Raghu Angadi made changes -
          Link This issue incorporates HADOOP-5225 [ HADOOP-5225 ]
          Raghu Angadi made changes -
          Link This issue is related to HADOOP-5225 [ HADOOP-5225 ]
          Owen O'Malley made changes -
          Component/s dfs [ 12310710 ]

            People

            • Assignee:
              Raghu Angadi
              Reporter:
              Raghu Angadi
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development