Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-3877

Clarify if IgfsFile -> FileStatus conversion should treat groupBlockSize as blockSize

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 1.6
    • 2.0
    • igfs
    • None

    Description

      During Metrics tests repairing test org.apache.ignite.igfs.Hadoop1DualAbstractTest#testMetricsBlock revealed the following problem:
      org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem#convert(org.apache.ignite.igfs.IgfsFile) method treats groupBlockSize as blockSize for Hadoop FileStatus. groupBlockSize can be several times larger than blockSize, so blockSize in status gets different to that in original IgfsFile .

      changing file.groupBlockSize() to file.blockSize() fixes problem in metrics tests, but creates problems in Hadoop tests that are bound to splits calculation, since split calculation related to blockSizes.

      Need to
      1) clarify if the treatment of groupBlcokSize was intentional.
      2) fix either metrics tests or Hadoop tests.

      Attachments

        Issue Links

          Activity

            People

              vozerov Vladimir Ozerov
              iveselovskiy Ivan Veselovsky
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: