Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6460

Accelerated time in SLS

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Be able to accelerate time in SLS.To do that, a timescalefactor parameter is introduced (default value = 1)
      With if we use a time factor of X, time in simulation will be X times faster than real. Time in generated CSV will be modified a well to have the same result as if we don't use timescalefactor.

      For example, it permits to run a simulation of one week of jobs in just one day if we use timescalefactor=7

      To do that a ScaleClock object has been introduced, which implements org.apache.hadoop.yarn.util.Clock. It also extends com.codahale.metrics.Clock for metrics reported in csv.
      All objects used for the simulation now use a shared reference to a org.apache.hadoop.yarn.util.Clock instance to get current time instead of using System.currentTimeMillis()

      A new optionnal parameter --timescalefactor=<factor> has been introduced on slsrun.sh script.

      Attachments

        1. YARN-6460.000.patch
          30 kB
          Julien Vaudour
        2. YARN-6460.001.patch
          31 kB
          Julien Vaudour
        3. YARN-6460.002.patch
          31 kB
          Julien Vaudour
        4. YARN-6460-branch-2.000.patch
          29 kB
          Julien Vaudour
        5. YARN-6460-branch-2.001.patch
          30 kB
          Julien Vaudour
        6. YARN-6460-branch-2.002.patch
          31 kB
          Julien Vaudour

        Activity

          People

            seneque Julien Vaudour
            seneque Julien Vaudour
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: