Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1511

Hive plan serialization is slow

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7.0, 0.11.0
    • 0.13.0
    • None
    • Incompatible change
    • Any 3rd party UDFs used must be declared as public classes.

    Description

      As reported by Edward Capriolo:

      For reference I did this as a test case....
      SELECT * FROM src where
      key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0
      OR key=0 OR key=0 OR key=0 OR
      key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0
      OR key=0 OR key=0 OR key=0 OR
      ...(100 more of these)

      No OOM but I gave up after the test case did not go anywhere for about
      2 minutes.

      Attachments

        1. failedPlan.xml
          236 kB
          Mohammad Islam
        2. generated_plan.xml
          256 kB
          Mohammad Islam
        3. HIVE-1511.10.patch
          49 kB
          Ashutosh Chauhan
        4. HIVE-1511.11.patch
          63 kB
          Brock Noland
        5. HIVE-1511.12.patch
          64 kB
          Mohammad Islam
        6. HIVE-1511.13.patch
          51 kB
          Mohammad Islam
        7. HIVE-1511.14.patch
          54 kB
          Ashutosh Chauhan
        8. HIVE-1511.16.patch
          371 kB
          Ashutosh Chauhan
        9. HIVE-1511.17.patch
          373 kB
          Ashutosh Chauhan
        10. HIVE-1511.4.patch
          35 kB
          Brock Noland
        11. HIVE-1511.5.patch
          37 kB
          Brock Noland
        12. HIVE-1511.6.patch
          43 kB
          Brock Noland
        13. HIVE-1511.7.patch
          43 kB
          Brock Noland
        14. HIVE-1511.8.patch
          45 kB
          Brock Noland
        15. HIVE-1511.9.patch
          48 kB
          Brock Noland
        16. HIVE-1511.patch
          6 kB
          Ashutosh Chauhan
        17. HIVE-1511.wip.9.patch
          48 kB
          Mohammad Islam
        18. HIVE-1511-wip.patch
          20 kB
          Ashutosh Chauhan
        19. HIVE-1511-wip2.patch
          15 kB
          Ashutosh Chauhan
        20. HIVE-1511-wip3.patch
          33 kB
          Ashutosh Chauhan
        21. HIVE-1511-wip4.patch
          35 kB
          Brock Noland
        22. KryoHiveTest.java
          2 kB
          Mohammad Islam
        23. run.sh
          0.7 kB
          Mohammad Islam

        Issue Links

          Activity

            People

              kamrul Mohammad Islam
              nzhang Ning Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: