Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2033

[Herriot] Gridmix generate data tests with various submission policies and different user resolvers.

    Details

    • Tags:
      herriot

      Description

      Tests for submitting and verifying the gridmix generate input data in different submission policies and various user resolver modes. It covers the following scenarios.

      1. Generate the data in a STRESS submission policy with SubmitterUserResolver mode and verify whether the generated data matches with given size of input or not.
      2. Generate the data in a REPLAY submission policy with RoundRobinUserResolver mode and verify whether the generated data matches with the given input size or not.
      3. Generate the data in a SERIAL submission policy with EchoUserResolver mode and specify the no.of bytes per file. Verify whether each file size is matches with given per file size or not and also verify the overall size of generated data.

      1. MAPREDUCE-2033.patch
        21 kB
        Vinay Kumar Thota
      2. MAPREDUCE-2033.patch
        23 kB
        Vinay Kumar Thota
      3. MAPREDUCE-2033.patch
        25 kB
        Vinay Kumar Thota
      4. MAPREDUCE-2033.patch
        25 kB
        Vinay Kumar Thota
      5. 2033-ydist.patch
        15 kB
        Vinay Kumar Thota
      6. 2033-ydist.patch
        21 kB
        Vinay Kumar Thota

        Issue Links

          Activity

          Vinay Kumar Thota created issue -
          Vinay Kumar Thota made changes -
          Field Original Value New Value
          Summary [Herriot] Gridmix generate data tests with various submission poilcies and different user resolvers. [Herriot] Gridmix generate data tests with various submission policies and different user resolvers.
          Vinay Kumar Thota made changes -
          Link This issue blocks MAPREDUCE-2030 [ MAPREDUCE-2030 ]
          Vinay Kumar Thota made changes -
          Link This issue requires MAPREDUCE-2019 [ MAPREDUCE-2019 ]
          Vinay Kumar Thota made changes -
          Attachment 2033-ydist.patch [ 12453673 ]
          Vinay Kumar Thota made changes -
          Attachment 2033-ydist.patch [ 12454101 ]
          Vinay Kumar Thota made changes -
          Link This issue requires HADOOP-6944 [ HADOOP-6944 ]
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2033.patch [ 12455015 ]
          Konstantin Boudnik made changes -
          Tags herriot
          Hide
          Vinay Kumar Thota added a comment -

          Patch for trunk.

          Show
          Vinay Kumar Thota added a comment - Patch for trunk.
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2033.patch [ 12456266 ]
          Hide
          Ranjit Mathew added a comment -

          +1

          Thanks for doing this.

          Show
          Ranjit Mathew added a comment - +1 Thanks for doing this.
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2033.patch [ 12458140 ]
          Hide
          Vinay Kumar Thota added a comment -

          Changed the package structure for gridmix system tests specific classes.

          Show
          Vinay Kumar Thota added a comment - Changed the package structure for gridmix system tests specific classes.
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2033.patch [ 12460238 ]
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2033.patch [ 12460238 ]
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2033.patch [ 12460241 ]
          Vinay Kumar Thota made changes -
          Link This issue is part of MAPREDUCE-2517 [ MAPREDUCE-2517 ]
          Hide
          Amar Kamat added a comment -

          Committed as part of MAPREDUCE-2517.

          Show
          Amar Kamat added a comment - Committed as part of MAPREDUCE-2517 .
          Amar Kamat made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 0.23.0 [ 12315570 ]
          Resolution Fixed [ 1 ]
          Amar Kamat made changes -
          Labels gridmix system-tests
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Resolved Resolved
          294d 1h 16m 1 Amar Kamat 15/Jun/11 11:06
          Resolved Resolved Closed Closed
          152d 13h 41m 1 Arun C Murthy 15/Nov/11 00:48

            People

            • Assignee:
              Vinay Kumar Thota
              Reporter:
              Vinay Kumar Thota
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development