Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1498

Add RC Testing to Docker based Bigtop provisioner

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 1.0.0
    • Component/s: deployment
    • Labels:
      None

      Description

      This adds the same functionality as BIGTOP-1449 does to our Docker based Bigtop provisioner(BIGTOP-1417).

      1. BIGTOP-1498.1.patch
        7 kB
        Evans Ye
      2. BIGTOP-1498.2.patch
        9 kB
        Evans Ye

        Activity

        Hide
        evans_ye Evans Ye added a comment -

        Patch uploaded.
        jay vyas would you might to review it and give me some feedback?
        Appreciate that!

        Show
        evans_ye Evans Ye added a comment - Patch uploaded. jay vyas would you might to review it and give me some feedback? Appreciate that!
        Hide
        jayunit100 jay vyas added a comment -

        Sure I'll try it out. This will be a great tool for evolving the smoke tests and verifying releases without Depending on vbox.

        Show
        jayunit100 jay vyas added a comment - Sure I'll try it out. This will be a great tool for evolving the smoke tests and verifying releases without Depending on vbox.
        Hide
        jayunit100 jay vyas added a comment -

        good work Evans Ye works beautifully. +1 and commiting shortly !

        Show
        jayunit100 jay vyas added a comment - good work Evans Ye works beautifully. +1 and commiting shortly !
        Hide
        jayunit100 jay vyas added a comment -

        commited............! now the docker based recipe also automatically runs smoke test !

        >./docker-hadoop.sh --smoke-tests
        

        Interestingly, the test indeed runs faster in 3 node docker (50 seconds for a pig job) than in VMs (1 minute, 30 seconds).

        cool !

        Show
        jayunit100 jay vyas added a comment - commited............! now the docker based recipe also automatically runs smoke test ! >./docker-hadoop.sh --smoke-tests Interestingly, the test indeed runs faster in 3 node docker (50 seconds for a pig job) than in VMs (1 minute, 30 seconds). cool !
        Hide
        evans_ye Evans Ye added a comment -

        Yes, I think this is reasonable. After all, containers are groups of processes running on host machine directly. This allows applications to have native speed compared to VMs.

        Show
        evans_ye Evans Ye added a comment - Yes, I think this is reasonable. After all, containers are groups of processes running on host machine directly. This allows applications to have native speed compared to VMs.
        Hide
        cos Konstantin Boudnik added a comment - - edited

        Guys, can we document this new feature on the Wiki or something? I am afraid that with the influx of new stuff - which is incredibly great btw, THANKS for doing this! - we'll get into the situation that only a few ppl in the community know how to use them

        Show
        cos Konstantin Boudnik added a comment - - edited Guys, can we document this new feature on the Wiki or something? I am afraid that with the influx of new stuff - which is incredibly great btw, THANKS for doing this! - we'll get into the situation that only a few ppl in the community know how to use them
        Show
        jayunit100 jay vyas added a comment - https://cwiki.apache.org/confluence/display/BIGTOP/Index updated !
        Hide
        jayunit100 jay vyas added a comment -

        To handle the influx, ive created BIGTOP-1507 . lets maintain, in the code, a graph of bigtops architecture, including the testing and vm components

        Show
        jayunit100 jay vyas added a comment - To handle the influx, ive created BIGTOP-1507 . lets maintain, in the code, a graph of bigtops architecture, including the testing and vm components

          People

          • Assignee:
            evans_ye Evans Ye
            Reporter:
            evans_ye Evans Ye
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development