Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1751

Intrinsic limits for HDFS files, directories

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.23.0
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Enforce a configurable limit on:
      the length of a path component
      the number of names in a directory

      The intention is to prevent a too-long name or a too-full directory. This is not about RPC buffers, the length of command lines, etc. There may be good reasons for those kinds of limits, but that is not the intended scope of this feature. Consequently, a reasonable implementation might be to extend the existing quota checker so that it faults the creation of a name that violates the limits. This strategy of faulting new creation evades the problem of existing names or directories that violate the limits.

      1. HDFS-1751.patch
        20 kB
        Daryn Sharp
      2. HDFS-1751-2.patch
        21 kB
        Daryn Sharp
      3. HDFS-1751-3.patch
        16 kB
        Daryn Sharp
      4. HDFS-1751-4.patch
        16 kB
        Daryn Sharp
      5. HDFS-1751-5.patch
        16 kB
        Daryn Sharp
      6. HDFS-1751-6.patch
        16 kB
        Daryn Sharp

        Issue Links

          Activity

          Daryn Sharp created issue -
          Daryn Sharp made changes -
          Field Original Value New Value
          Attachment HDFS-1751.patch [ 12473571 ]
          Daryn Sharp made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Daryn Sharp made changes -
          Attachment HADOOP-7175-2.patch [ 12473709 ]
          Daryn Sharp made changes -
          Attachment HADOOP-7175-2.patch [ 12473709 ]
          Daryn Sharp made changes -
          Attachment HDFS-1751-2.patch [ 12473710 ]
          Daryn Sharp made changes -
          Attachment HDFS-1751-3.patch [ 12473850 ]
          Daryn Sharp made changes -
          Attachment HDFS-1751-4.patch [ 12473855 ]
          Daryn Sharp made changes -
          Attachment HDFS-1751-5.patch [ 12476025 ]
          Daryn Sharp made changes -
          Attachment HDFS-1751-6.patch [ 12476035 ]
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Chris Nauroth made changes -
          Link This issue is related to HDFS-6055 [ HDFS-6055 ]
          Chris Nauroth made changes -
          Link This issue is related to HDFS-6099 [ HDFS-6099 ]

            People

            • Assignee:
              Daryn Sharp
              Reporter:
              Daryn Sharp
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development