Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-7541

SQL COPY command: implement backend switching option

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: sql
    • Labels:
      None

      Description

      When we load data using COPY command we can add key/value pairs to the cache using different ways:

      • Directly calling cache.putAll()
      • Loading data via DataStreamer
      • etc.

      Every backend has its pros and cons. For example, the streamer is fast and asynchronous, although it cannot replace value and cannot provide any statistics – such as number of added records. The direct interface is slow and synchronous, but provides us with an ability to either replace or skip the records with the same key and respond to the user with full statistics.

      There shall be an option in the SQL command to switch to particular backend. For example:

      COPY
          FROM 'file'
          ...
          [BACKEND (DIRECT | STREAMER)]
      
      We might have more backends in the future.
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                kirill.shirokov Kirill Shirokov
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: