Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-2648

Phoenix Spark Integration does not allow Dynamic Columns to be mapped

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 4.6.0
    • Fix Version/s: 4.6.0
    • Environment:

      phoenix-spark-4.6.0-HBase-0.98 , spark-1.5.0-bin-hadoop2.4

    • Flags:
      Patch, Important

      Description

      I am using spark-1.5.0-bin-hadoop2.4 and phoenix-spark-4.6.0-HBase-0.98 to load phoenix tables on hbase to Spark RDD. Using the steps in https://phoenix.apache.org/phoenix_spark.html, I can successfully map standard columns in a table to Phoenix RDD.
      But my table has some important dynamic columns (https://phoenix.apache.org/dynamic_columns.html) which are not getting mapped to Spark RDD in this process.(using sc.phoenixTableAsRDD)
      This is proving a showstopper for me for using phoenix with spark.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                xiaopeng-liao Xiaopeng Liao
                Reporter:
                suman_d123 Suman Datta
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: