Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2133

Master Server Crash from mismatched schemas using Spark Context

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.4.0
    • Fix Version/s: None
    • Component/s: java, rpc
    • Labels:
      None

      Description

      While creating a table in Kudu using kud-spark KuduContext I omitted the `.nullable(true)` option from several fields when I generated a schema so I could add partitions using schema.newPartialRow. KuduContext.createTable takes a spark StructType as an argument and adds the nullable(true). When calling createTable the MasterServer reliably crashes, I think, because of this conflict in nullable fields.

        Attachments

        1. 6b08ef81-ddb8-8caa-241e8ae7-7800226c.dmp
          716 kB
          Benjamin Guidarelli
        2. 3b055209-58c0-24a8-3cd396a4-4fa7d010.dmp
          950 kB
          Benjamin Guidarelli

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                barnjamin Benjamin Guidarelli
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: