Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4949 Centralized cache management in HDFS
  3. HDFS-5378

In CacheReport, don't send genstamp and length on the wire

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-4949
    • HDFS-4949
    • datanode
    • None

    Description

      As discussed in HDFS-5096, we don't need genstamp and block length when processing cache reports. So let's not send them over the wire (it increases the size of cache reports to 3x what it could be).

      Also, we should report the caching statistics alongside the normal DN stats in StorageReport. There's no reason for them to be separate. Since the new fields will be optional and default to 0, there will be no extra overhead in the non-caching case.

      Attachments

        1. HDFS-5378-caching.001.patch
          36 kB
          Colin McCabe
        2. HDFS-5378-caching.002.patch
          36 kB
          Colin McCabe
        3. HDFS-5378-caching.003.patch
          35 kB
          Colin McCabe
        4. HDFS-5378-caching.004.patch
          39 kB
          Colin McCabe

        Activity

          People

            cmccabe Colin McCabe
            cmccabe Colin McCabe
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: