Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1577

Spark insert-ignore is significantly slower that upsert

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • NA
    • perf

    Description

      We have seen cases where running and insert-ignore spark ingestion job is significantly (10x) slower than the equivalent job using upsert. Not sure at this point if it's due to the increased error messages being returned by the server, or if it's the client not handling them efficiently.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. KUDU-1563 Add support for INSERT/UPDATE/DELETE IGNORE

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              danburkert Dan Burkert
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: