Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8288

HBaseFileSystem: Refactoring and correct semantics for createPath methods

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.6
    • Fix Version/s: 0.94.7
    • Component/s: Filesystem Integration
    • Labels:
      None

      Description

      This jira is for two issues I see in the HBaseFileSystem class:
      1) Load testing on a 7 node cluster using ycsb insert workload shows that static initialization of conf properties results in a slightly better throughput. Though the initialization uses HBaseConfiguration.create() call which is expensive (and I tried to avoid that in its first version), this class is used for most of the filesystem class, and had to invoke an additional checkAndSetXX call before making the fs call because it is not certain whether the retry properties are set or not. Having initialize them in static block removes that limitation.

      2) Correct semantics for CreatePathXXX method. In case the overwrite flag is false and file already exists, underlying fs throws an exception. It should be re-thrown to the caller.

        Attachments

        1. HBase-8288-v1.patch
          9 kB
          Himanshu Vashishtha
        2. HBase-8288-v2.patch
          47 kB
          Himanshu Vashishtha
        3. HBase-8288-v3.patch
          47 kB
          Himanshu Vashishtha

          Activity

            People

            • Assignee:
              v.himanshu Himanshu Vashishtha
              Reporter:
              v.himanshu Himanshu Vashishtha
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: