Uploaded image for project: 'Calcite'
  1. Calcite
  2. CALCITE-1227

Add streaming CSV table

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.9.0
    • None
    • None

    Description

      Add a variant of CsvTable that can be streamed. It would serve as an example of how to write stream adapters.

      It would be like the CSV adapter, but watches a file and reports records added to the end of the file (like the tail command).

      You’d have to change CsvTable to implement StreamableTable, and implement the Table stream() method to return a variant of the table that is in “follow” mode.

      It would probably be implemented by a variant of CsvEnumerator, but it is getting its input in bursts, as the file is appended to.

      You would still be able to use this adapter to read historical data from the CSV file. Appending records to the file would make a nice demo.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            julianhyde Julian Hyde
            julianhyde Julian Hyde
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment