Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-6633

Use standard JDBC URL in Spark Connector and make it optional

    XMLWordPrintableJSON

Details

    • Hide
      The zkUrl parameter for specifying the Phoenix/HBase ZK quorum has been deprecated.
      The new jdbcUrl parameter has been added, which expects a standard Phoenix JDBC URL (i.e. jdbc:phoenix...), which is passed to Phoenix without additional processing.
      If neither zkUrl nor jdbcUrl is specified, then Phoenix will fall back to the default HBase registry determined from hbase-site.xml.
      This change also enables the upcoming ZooKeeper-less registry support in Phoenix.

      Note that this change only applies to the new DataSourceV2 based "phoenix" data source.
      The old deprecated DataSourceV1 based "org.apache.phoenix.spark" data source hasn't been updated, and still only works with ZooKeeper based phoenix client configuration.
      Show
      The zkUrl parameter for specifying the Phoenix/HBase ZK quorum has been deprecated. The new jdbcUrl parameter has been added, which expects a standard Phoenix JDBC URL (i.e. jdbc:phoenix...), which is passed to Phoenix without additional processing. If neither zkUrl nor jdbcUrl is specified, then Phoenix will fall back to the default HBase registry determined from hbase-site.xml. This change also enables the upcoming ZooKeeper-less registry support in Phoenix. Note that this change only applies to the new DataSourceV2 based "phoenix" data source. The old deprecated DataSourceV1 based "org.apache.phoenix.spark" data source hasn't been updated, and still only works with ZooKeeper based phoenix client configuration.

    Description

      We require explicitly specifying the ZK URL for the Phoenix-Spark connector.
      Since having hbase-site.xml on the classpath is required by Phoenix anyway, we could use the quorum from hbase-site.xml as default, which would make life easier for users.

      Phoenix already handles this, we just need to remove the check, and adopt the JDBC URL not to specify the ZK quorum if missing.

      The current zkUrl code also acts as an aritificial limitation on using the new zookeeperless Hbase registries from Spark.
      We need to deprecate zkUrl, and add a new jdbcUrl property, which is simply passed to Phoenix without further processing.

      Attachments

        Issue Links

          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. PHOENIX-6523 Support for HBase Registry Implementations through Phoenix connection URL

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. PHOENIX-7053 Use full JDBC URL in Pherf instead of ZK quorum

          • Major - Major loss of function.
          • Open
          split to

          Bug - A problem which impairs or prevents the functions of the product. PHOENIX-7050 Add jdbcURL parameter to the old Scala Phoenix Spark Data Source

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open
          links to

          Web Link GitHub Pull Request #108

          Activity

            People

              stoty Istvan Toth
              stoty Istvan Toth
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: