Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.2.0
    • Fix Version/s: 3.2.0
    • Component/s: fs/azure
    • Labels:
    • Target Version/s:

      Description

      We intend to change the default blocksize of the abfs driver to 256Mb from 512MB.

      After changing the blocksize we have performed a series of test(Spark Tera, Spark DFSIO,TPCDS on HIVE) and have seen consistent improvements in order of 4-5 %

        Attachments

        1. HADOOP-16404-001.patch
          2 kB
          Da Zhou
        2. HADOOP-16404.patch
          2 kB
          Arun Singh

          Activity

            People

            • Assignee:
              singharun02101990 Arun Singh
              Reporter:
              singharun02101990 Arun Singh
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: