Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-4541

Create test for Hadoop running in external JVM

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 1.8
    • None
    • hadoop
    • None

    Description

      Problem
      Currently we run all Hadoop tests in synthetic "single JVM" mode. This way we miss lots of potential issues. We need to be able to run them in real distributed mode, but on a single machine.

      Simplified solution
      1) Start N external nodes
      2) Submit a job to these nodes and validate the result

      We can start with simple Teragen->Terasort->Teravalidate scenario.

      Please look through Process and ProcessBuilder classes usages - most probably we already have all necessary infrastructure to start nodes in external JVM.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              vozerov Vladimir Ozerov
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: