[PHOENIX-2648] Phoenix Spark Integration does not allow Dynamic Columns to be mapped

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.6.0
• Fix Version/s: 4.6.0
• Labels: patch phoenixTableAsRDD spark

Environment

phoenix-spark-4.6.0-HBase-0.98 , spark-1.5.0-bin-hadoop2.4

• Flags: Patch, Important
• Assignee: Xiaopeng Liao
• Reporter: Suman Datta
• Created: 02/Feb/16 10:16
• Updated: 19/Apr/17 19:12

Description

I am using spark-1.5.0-bin-hadoop2.4 and phoenix-spark-4.6.0-HBase-0.98 to load phoenix tables on hbase to Spark RDD. Using the steps in https://phoenix.apache.org/phoenix_spark.html, I can successfully map standard columns in a table to Phoenix RDD.
But my table has some important dynamic columns (https://phoenix.apache.org/dynamic_columns.html) which are not getting mapped to Spark RDD in this process.(using sc.phoenixTableAsRDD)
This is proving a showstopper for me for using phoenix with spark.

Issue Links

• links to: GitHub Pull Request #196