Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22510

Exceptions caused by 64KB JVM bytecode or 64K constant pool entry limit

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.2.0
    • None
    • SQL

    Description

      Codegen can throw an exception due to the 64KB JVM bytecode or 64K constant pool entry limit.

      Attachments

        1.
        		 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create() Sub-task Resolved Kazuaki Ishizaki
        2.
        		 64KB JVM bytecode limit problem with in Sub-task Resolved Kazuaki Ishizaki
        3.
        		 64KB JVM bytecode limit problem with cast Sub-task Resolved Kazuaki Ishizaki
        4.
        		 64KB JVM bytecode limit problem with least and greatest Sub-task Resolved Kazuaki Ishizaki
        5.
        		 64KB JVM bytecode limit problem with concat Sub-task Resolved Kazuaki Ishizaki
        6.
        		 Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception Sub-task Resolved Marco Gaido
        7.
        		 Increase default value of spark.sql.codegen.maxFields Sub-task Resolved Unassigned
        8.
        		 Filter predicate with many conditions throw stackoverflow error Sub-task Resolved Kazuaki Ishizaki
        9.
        		 SQL which has large ‘case when’ expressions may cause code generation beyond 64KB Sub-task Resolved Unassigned
        10.
        		 fix java 64kb compile error for deeply nested expressions Sub-task Resolved Wenchen Fan
        11.
        		 64KB JVM bytecode limit problem with concat_ws Sub-task Resolved Kazuaki Ishizaki
        12.
        		 64KB JVM bytecode limit problem with elt Sub-task Resolved Kazuaki Ishizaki
        13.
        		 Fix 64kb compile error for common expression types Sub-task Resolved Unassigned
        14.
        		 Create a lot of global variables to reuse an object in generated code Sub-task Resolved Kazuaki Ishizaki
        15.
        		 64KB JVM bytecode limit problem with FormatString Sub-task Resolved Kazuaki Ishizaki
        16.
        		 64KB JVM bytecode limit problem with GLM Sub-task Closed Unassigned
        17.
        		 Fix 64kb limit for deeply nested expressions under wholestage codegen Sub-task Resolved L. C. Hsieh
        18.
        		 elt should use splitExpressionsWithCurrentInputs to split expression codes Sub-task Resolved L. C. Hsieh
        19.
        		 Avoid unnecessary function calls in code generation Sub-task Resolved Marco Gaido
        20.
        		 Shorten lifetime of global variables used in HashAggregateExec Sub-task Resolved Unassigned
        21.
        		 64KB JVM bytecode limit problem with aggregation Sub-task Resolved Unassigned
        22.
        		 64KB JVM bytecode limit problem with filter Sub-task Resolved Unassigned
        23.
        		 splitExpression can create too many method calls (generating a Constant Pool limit error) Sub-task Resolved Marco Gaido
        24.
        		 org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificOrdering" grows beyond 64 KB Sub-task Resolved Liwei Lin
        25.
        		 Code Generation: Constant Pool Past Limit for Wide/Nested Dataset Sub-task Resolved Kazuaki Ishizaki
        26.
        		 Janino throws StackOverflowError on nested structs with many fields Sub-task Closed Unassigned

        Activity

          People

            kiszk Kazuaki Ishizaki
            smilegator Xiao Li
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: