Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2081

[GridMix3] Implement functionality for get the list of job traces which has different intervals.

    Details

    • Type: Test Test
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: contrib/gridmix
    • Labels:
      None
    • Tags:
      gridmix system-tests

      Description

      Girdmix system tests should require different job traces with different time intervals for generate and submit the gridmix jobs. So, implement a functionaliy for getting the job traces and arrange them in hash table with time interval as key.Also getting the list of traces from resource location irrespective of time. The following methods needs to implement.

      Method signature:
      public static Map <String, String> getMRTraces(Configuration conf) throws IOException; - it get the traces with time intervals from resources default location.

      public static Map <String, String> getMRTraces(Configuration conf,Path path) throws IOException; - it get the traces with time intervals from user specified resource location.

      public static List<String> listMRTraces(Configuration conf) throws IOException -it list all the traces from resource default location irrespective of time interval.

      public static List<String> listMRTraces(Configuration conf, Path tracesPath) throws IOException - it list all the traces from user specified user location irrespective of time interval.

      public static List<String> listMRTracesByTime(Configuration conf, String timeInterval) throws IOException - it list all traces of a given time interval from default resource location.

      public static List<String> listMRTracesByTime(Configuration conf, String timeInterval,Path path) throws IOException - it list all traces of a given time interval from a given resources location.

      1. MAPREDUCE-2081.patch
        558 kB
        Vinay Kumar Thota
      2. MAPREDUCE-2081.patch
        558 kB
        Vinay Kumar Thota
      3. 2081-ydist.patch
        33 kB
        Vinay Kumar Thota
      4. 2081-ydist.patch
        8 kB
        Vinay Kumar Thota
      5. 2081-ydist.patch
        7 kB
        Vinay Kumar Thota

        Issue Links

          Activity

          Vinay Kumar Thota created issue -
          Vinay Kumar Thota made changes -
          Field Original Value New Value
          Description Girdmix system tests should require different job traces with different time intervals for generate and submit the gridmix jobs. So, implement a method for getting the job traces and arrange them in hash table with time interval as key.

          Method signature:
          public static Hashtable <String, String> getJobTraces(Configuration conf) throws IOException;
          Girdmix system tests should require different job traces with different time intervals for generate and submit the gridmix jobs. So, implement a functionaliy for getting the job traces and arrange them in hash table with time interval as key.Also getting the list of traces from resource location irrespective of time. The following methods needs to implement.

          Method signature:
          public static Hashtable <String, String> getMRTraces(Configuration conf) throws IOException; - it get the traces with time intervals from resources default location.

          public static Hashtable <String, String> getMRTraces(Configuration conf,Path path) throws IOException; - it get the traces with time intervals from user specified resource location.


          public static ArrayList<String> listMRTraces(Configuration conf) throws IOException -it list all the traces from resource default location irrespective of time interval.
          public static ArrayList<String> listMRTraces(Configuration conf, Path tracesPath) throws IOException - it list all the traces from user specified user location irrespective of time interval.
          Vinay Kumar Thota made changes -
          Attachment 2081-ydist.patch [ 12456268 ]
          Vinay Kumar Thota made changes -
          Description Girdmix system tests should require different job traces with different time intervals for generate and submit the gridmix jobs. So, implement a functionaliy for getting the job traces and arrange them in hash table with time interval as key.Also getting the list of traces from resource location irrespective of time. The following methods needs to implement.

          Method signature:
          public static Hashtable <String, String> getMRTraces(Configuration conf) throws IOException; - it get the traces with time intervals from resources default location.

          public static Hashtable <String, String> getMRTraces(Configuration conf,Path path) throws IOException; - it get the traces with time intervals from user specified resource location.


          public static ArrayList<String> listMRTraces(Configuration conf) throws IOException -it list all the traces from resource default location irrespective of time interval.
          public static ArrayList<String> listMRTraces(Configuration conf, Path tracesPath) throws IOException - it list all the traces from user specified user location irrespective of time interval.
          Girdmix system tests should require different job traces with different time intervals for generate and submit the gridmix jobs. So, implement a functionaliy for getting the job traces and arrange them in hash table with time interval as key.Also getting the list of traces from resource location irrespective of time. The following methods needs to implement.

          Method signature:
          public static Map <String, String> getMRTraces(Configuration conf) throws IOException; - it get the traces with time intervals from resources default location.

          public static Map <String, String> getMRTraces(Configuration conf,Path path) throws IOException; - it get the traces with time intervals from user specified resource location.


          public static List<String> listMRTraces(Configuration conf) throws IOException -it list all the traces from resource default location irrespective of time interval.

          public static List<String> listMRTraces(Configuration conf, Path tracesPath) throws IOException - it list all the traces from user specified user location irrespective of time interval.

          public static List<String> listMRTracesByTime(Configuration conf, String timeInterval) throws IOException - it list all traces of a given time interval from default resource location.

          public static List<String> listMRTracesByTime(Configuration conf, String timeInterval,Path path) throws IOException - it list all traces of a given time interval from a given resources location.
          Vinay Kumar Thota made changes -
          Attachment 2081-ydist.patch [ 12456278 ]
          Vinay Kumar Thota made changes -
          Attachment 2081-ydist.patch [ 12456367 ]
          Vinay Kumar Thota made changes -
          Attachment 2081-ydist.patch [ 12456278 ]
          Vinay Kumar Thota made changes -
          Attachment 2081-ydist.patch [ 12456825 ]
          Vinay Kumar Thota made changes -
          Link This issue depends on MAPREDUCE-2095 [ MAPREDUCE-2095 ]
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2081.patch [ 12458131 ]
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2081.patch [ 12458131 ]
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2081.patch [ 12458146 ]
          Vinay Kumar Thota made changes -
          Attachment MAPREDUCE-2081.patch [ 12460240 ]
          Vinay Kumar Thota made changes -
          Link This issue is part of MAPREDUCE-2517 [ MAPREDUCE-2517 ]
          Amar Kamat made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 0.23.0 [ 12315570 ]
          Resolution Fixed [ 1 ]
          Tags gridmix system-tests
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue depends on MAPREDUCE-2095 [ MAPREDUCE-2095 ]
          Gavin made changes -
          Link This issue depends upon MAPREDUCE-2095 [ MAPREDUCE-2095 ]

            People

            • Assignee:
              Vinay Kumar Thota
              Reporter:
              Vinay Kumar Thota
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development