Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-1815

Use Spark Data Source API in phoenix-spark module

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.4.0
    • None
    • None

    Description

      Spark 1.3.0 introduces a new 'Data Source' API to standardize load and save methods for different types of data sources.

      The phoenix-spark module should implement the same API for use as a pluggable data store in Spark.

      ref:
      https://spark.apache.org/docs/latest/sql-programming-guide.html#data-sources

      https://databricks.com/blog/2015/01/09/spark-sql-data-sources-api-unified-data-access-for-the-spark-platform.html

      Attachments

        Issue Links

        is related to

        New Feature - A new feature of the product, which has yet to be developed. PHOENIX-1071 Provide integration for exposing Phoenix tables as Spark RDDs

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jmahonin Josh Mahonin
            jmahonin Josh Mahonin
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment