Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      The datanode now performs 4MB readahead by default when reading data from its disks, if the native libraries are present. This has been shown to improve performance in many workloads. The feature may be disabled by setting dfs.datanode.readahead.bytes to "0".
      Show
      The datanode now performs 4MB readahead by default when reading data from its disks, if the native libraries are present. This has been shown to improve performance in many workloads. The feature may be disabled by setting dfs.datanode.readahead.bytes to "0".

      Description

      The fadvise features have been implemented for some time, and we've enabled them in production at a lot of customer sites without difficulty. I'd like to enable the readahead feature by default in future versions so that users get this benefit without any manual configuration required.

      The other fadvise features seem to be more workload-dependent and need further testing before enabling by default.

      1. hdfs-3697-branch-1.txt
        4 kB
        Todd Lipcon
      2. hdfs-3697.txt
        5 kB
        Todd Lipcon
      3. hdfs-3697.txt
        5 kB
        Todd Lipcon

        Issue Links

          Activity

            People

            • Assignee:
              Todd Lipcon
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development