Uploaded image for project: 'Metron'
  1. Metron
  2. METRON-2088

Support HDP 3.1.0

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Metron currently supports HDP 2.6.5. We need to upgrade Metron to run against the stack provided by HDP 3.1.0.

      HDP Component Versions

      See initial discuss thread here.

        Attachments

          Issue Links

          1.
          Create CentOS 7 Development Environment Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 4h 50m
          2.
          Install Metron MPack in Ambari 2.7.3.0 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          3.
          Ambari client exception occurred: No JSON object could be decoded Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          4.
          Introduce HBase Connection Abstractions for HBase 2.0.2 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 10m
          5.
          Upgrade REST for HBase 2.0.2 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          6.
          Upgrade Profiler for HBase 2.0.2 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 17h 10m
          7.
          Upgrade to Kafka 2.0.0 and Storm 1.2.1 Sub-task Done Ryan Merriman

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 9h
          8.
          Upgrade to Solr 7.4.0 Sub-task Done Ryan Merriman

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 10m
          9.
          Upgrade to Zeppelin 0.8.0 Sub-task Done Ryan Merriman

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          10.
          Profiler Integration Test Fails After Storm 1.2.1 Upgrade Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          11.
          Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          12.
          Upgrade Core Enrichments for HBase 2.0.2 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          13.
          Upgrade Data Management for HBase 2.0.2 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          14.
          Remove Legacy HBase Client Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          15.
          Upgrade Streaming Enrichments for HBase 2.0.2 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          16.
          Merge Master into Feature Branch Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          17.
          Missing services in HDP 3.1 metron mpack and installer stuck Sub-task Done Mohan Venkateshaiah

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 10m
          18.
          PcapTopologyIntegrationTest Intermittent Failures Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          19.
          Upgrade to HBase 2.0.2 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 4h
          20.
          Isolate Curator Dependencies Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 50m
          21.
          Upgrade metron-hbase-client to HBase 2.0.2 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          22.
          Solr Indexing Topology Fails to Start on Secure Cluster with HDP 3.1 Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          23.
          Unable to Index to Solr with Kerberos Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          24.
          Enrichment Topology Unable to Load Geo IP Data from HDFS Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          25.
          Update Kerberos settings Sub-task Done Ryan Merriman

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 4h 10m
          26.
          Upgrade to Hadoop 3.1.1 Sub-task Done Michael Miklavcic

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 5h
          27.
          Remove Overrides for Storm 1.0.x Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          28.
          Deprecate CentOS 6 Development Environment Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          29.
          Building Against Wrong Storm Flux Version Sub-task Done Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          30.
          Reconcile Versions in Root POM with HDP 3.1 Sub-task In Progress Nick Allen

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h

            Activity

              People

              • Assignee:
                nickwallen Nick Allen
                Reporter:
                nickwallen Nick Allen
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 75h 50m
                  75h 50m