Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6549 Enable file handle cache by default
  3. IMPALA-6807

Known Issues needs to be updated to reflect resolution of HDFS-12528

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 2.12.0
    • Fix Version/s: Impala 2.12.0
    • Component/s: Docs
    • Labels:
      None

      Description

      In docs/topics/impala_known_issues.xml, we have a section "ki_file_handle_cache" that covers the interaction of the file handle cache with short circuit reads. This is related to the HDFS issue HDFS-12528.

      HDFS-12528 is resolved. The way it was resolved is to introduce an HDFS parameter dfs.domain.socket.disable.interval.seconds that specifies the amount of time that short circuit reads are disabled. The default value for upstream Hadoop is 10 minutes (600 seconds). It can be customized, and the default value for CDH is 1 second. 

      I think this section should recommend running with dfs.domain.socket.disable.interval.seconds set to a small value (CDH uses 1 second) when using file handle cache. However, 0 is not recommended. 

        Attachments

          Activity

            People

            • Assignee:
              arodoni_cloudera Alex Rodoni
              Reporter:
              joemcdonnell Joe McDonnell
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: