Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2133

Master Server Crash from mismatched schemas using Spark Context

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • 1.4.0
    • NA
    • java, master
    • None

    Description

      While creating a table in Kudu using kud-spark KuduContext I omitted the `.nullable(true)` option from several fields when I generated a schema so I could add partitions using schema.newPartialRow. KuduContext.createTable takes a spark StructType as an argument and adds the nullable(true). When calling createTable the MasterServer reliably crashes, I think, because of this conflict in nullable fields.

      Attachments

        1. 3b055209-58c0-24a8-3cd396a4-4fa7d010.dmp
          950 kB
          Benjamin Guidarelli
        2. 6b08ef81-ddb8-8caa-241e8ae7-7800226c.dmp
          716 kB
          Benjamin Guidarelli

        Issue Links

          Activity

            People

              Unassigned Unassigned
              barnjamin Benjamin Guidarelli
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: