Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1577

Spark insert-ignore is significantly slower that upsert

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • NA
    • perf

    Description

      We have seen cases where running and insert-ignore spark ingestion job is significantly (10x) slower than the equivalent job using upsert. Not sure at this point if it's due to the increased error messages being returned by the server, or if it's the client not handling them efficiently.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              danburkert Dan Burkert
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: