Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1511

Hive plan serialization is slow

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0, 0.11.0
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
    • Hadoop Flags:
      Incompatible change
    • Release Note:
      Any 3rd party UDFs used must be declared as public classes.

      Description

      As reported by Edward Capriolo:

      For reference I did this as a test case....
      SELECT * FROM src where
      key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0
      OR key=0 OR key=0 OR key=0 OR
      key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0
      OR key=0 OR key=0 OR key=0 OR
      ...(100 more of these)

      No OOM but I gave up after the test case did not go anywhere for about
      2 minutes.

        Attachments

        1. HIVE-1511.17.patch
          373 kB
          Ashutosh Chauhan
        2. HIVE-1511.16.patch
          371 kB
          Ashutosh Chauhan
        3. HIVE-1511.14.patch
          54 kB
          Ashutosh Chauhan
        4. HIVE-1511.13.patch
          51 kB
          Mohammad Kamrul Islam
        5. HIVE-1511.12.patch
          64 kB
          Mohammad Kamrul Islam
        6. HIVE-1511.11.patch
          63 kB
          Brock Noland
        7. HIVE-1511.10.patch
          49 kB
          Ashutosh Chauhan
        8. HIVE-1511.9.patch
          48 kB
          Brock Noland
        9. failedPlan.xml
          236 kB
          Mohammad Kamrul Islam
        10. HIVE-1511.wip.9.patch
          48 kB
          Mohammad Kamrul Islam
        11. KryoHiveTest.java
          2 kB
          Mohammad Kamrul Islam
        12. generated_plan.xml
          256 kB
          Mohammad Kamrul Islam
        13. run.sh
          0.7 kB
          Mohammad Kamrul Islam
        14. HIVE-1511.8.patch
          45 kB
          Brock Noland
        15. HIVE-1511.7.patch
          43 kB
          Brock Noland
        16. HIVE-1511.6.patch
          43 kB
          Brock Noland
        17. HIVE-1511.5.patch
          37 kB
          Brock Noland
        18. HIVE-1511.4.patch
          35 kB
          Brock Noland
        19. HIVE-1511-wip4.patch
          35 kB
          Brock Noland
        20. HIVE-1511-wip3.patch
          33 kB
          Ashutosh Chauhan
        21. HIVE-1511-wip2.patch
          15 kB
          Ashutosh Chauhan
        22. HIVE-1511-wip.patch
          20 kB
          Ashutosh Chauhan
        23. HIVE-1511.patch
          6 kB
          Ashutosh Chauhan

          Issue Links

            Activity

              People

              • Assignee:
                kamrul Mohammad Kamrul Islam
                Reporter:
                nzhang Ning Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: