Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15743

vectorized text parsing: speed up double parse

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None

    Description

      Double.parseDouble(
                new String(bytes, fieldStart, fieldLength, StandardCharsets.UTF_8));

      This takes ~25% of the query time in some cases.

      Attachments

        1. tpch-without.png
          277 kB
          Sergey Shelukhin
        2. HIVE-15743.1.patch
          76 kB
          Teddy Choi
        3. HIVE-15743.2.patch
          12 kB
          Teddy Choi
        4. HIVE-15743.3.patch
          13 kB
          Teddy Choi
        5. HIVE-15743.4.patch
          13 kB
          Teddy Choi

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HIVE-16148 Flaky test: schema_evol_text_vec_table

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Task - A task that needs to be done. HIVE-28155 StringToDouble.java violates the ASF 3rd party license guidelines

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link Review Board

          Activity

            People

              teddy.choi Teddy Choi
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: