Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14160

backport hbase-spark module to branch-1 and branch-2

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 1.3.0
    • Fix Version/s: None
    • Component/s: spark
    • Labels:
      None

      Description

      Once the hbase-spark module gets polished a bit, we should backport to branch-1 and branch-2 so we can publish it sooner.

      needs (per previous discussion):

      • examples refactored into different module
      • user facing documentation
      • defined public API

        Attachments

          Issue Links

          depends upon

          Sub-task - The sub-task of the issue HBASE-14801 Enhance the Spark-HBase connector catalog with json format

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-14406 The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-15271 Spark Bulk Load: Need to write HFiles to tmp location then rename to protect from Spark Executor Failures

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HBASE-13992 Integrate SparkOnHBase into HBase

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-14158 Add documentation for Initial Release for HBase-Spark Module integration

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-14159 Resolve warning introduced by HBase-Spark module

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-14167 hbase-spark integration tests do not respect -DskipIntegrationTests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. HBASE-14375 Define public API for spark integration module

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Task - A task that needs to be done. HBASE-14161 Add hbase-spark integration tests to IT jenkins job

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HBASE-14376 move hbase spark integration examples into their own module

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Sub-task - The sub-task of the issue HBASE-15473 Documentation for the usage of hbase dataframe user api (JSON, Avro, etc)

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-17766 Generate Javadoc for hbase-spark module

          • Major - Major loss of function.
          • In Progress

          Bug - A problem which impairs or prevents the functions of the product. HBASE-16246 Ensure avro version in hbase-spark matches that shipped in our default hadoop profile

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-15184 SparkSQL Scan operation doesn't work on kerberos cluster

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-15597 Clean up configuration keys used in hbase-spark module

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Test - A new unit, integration or system test. HBASE-18175 Add hbase-spark integration test into hbase-spark-it

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-16845 Run tests under hbase-spark module in test phase

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-17574 Clean up how to run tests under hbase-spark module

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-15201 Add hbase-spark to hbase assembly

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. HBASE-15644 Add maven-scala-plugin for scaladoc

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                busbey Sean Busbey
              • Votes:
                1 Vote for this issue
                Watchers:
                21 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: