Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9188

Make block corruption related tests FsDataset-agnostic.

          Details

          • Type: Improvement
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 2.7.1
          • Fix Version/s: 2.8.0, 3.0.0-alpha1
          • Component/s: test
          • Labels:
            None
          • Target Version/s:
          • Hadoop Flags:
            Reviewed

            Description

            Currently, HDFS does block corruption tests by directly accessing the files stored on the storage directories, which assumes FsDatasetImpl is the dataset implementation. However, with works like OZone (HDFS-7240) and HDFS-8679, there will be different FsDataset implementations.

            So we need a general way to run whitebox tests like corrupting blocks and crc files.

              Attachments

              1. HDFS-9188.000.patch
                33 kB
                Lei (Eddy) Xu
              2. HDFS-9188.001.patch
                33 kB
                Lei (Eddy) Xu
              3. HDFS-9188.002.patch
                33 kB
                Lei (Eddy) Xu
              4. HDFS-9188.003.patch
                34 kB
                Lei (Eddy) Xu
              5. HDFS-9188.004.patch
                40 kB
                Lei (Eddy) Xu
              6. HDFS-9188.005.patch
                41 kB
                Lei (Eddy) Xu
              7. HDFS-9188.006.patch
                39 kB
                Lei (Eddy) Xu

                Issue Links

                is required by

                Improvement - An improvement or enhancement to an existing feature or task. HDFS-9282 Make data directory count and storage raw capacity related tests FsDataset-agnostic

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      eddyxu Lei (Eddy) Xu
                      Reporter:
                      eddyxu Lei (Eddy) Xu
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      9 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: