Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14789 Enhance the current spark-hbase connector
  3. HBASE-15334

Add avro support for spark hbase connector

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None
    • None
    • Reviewed

    Description

      Avro is a popular format for hbase storage. User may want the support natively in the connector.

      With the support, user can save serialized avro into hbase table, and then query on top of it using spark sql. The conversion between avro and catalyst datatype will be handled automatically. This is one way of support complex data types. Otherwise, user has to define their own customized Serdes to support complex data types.

      Attachments

        1. HBASE-15334-1.patch
          37 kB
          Zhan Zhang
        2. HBASE-15334-2.patch
          37 kB
          Zhan Zhang
        3. HBASE-15334-3.patch
          37 kB
          Zhan Zhang
        4. HBASE-15334-4.patch
          37 kB
          Zhan Zhang
        5. HBASE-15334-5.patch
          37 kB
          Zhan Zhang

        Issue Links

          links to

          Web Link ReviewBoard

          Activity

            People

              zzhan Zhan Zhang
              zzhan Zhan Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: