Pig
  1. Pig
  2. PIG-2964

Add helper method getJobList() to PigStats.JobGraph. Extend visibility of couple methods on same class

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.11
    • Component/s: None
    • Labels:
      None
    • Tags:
      API

      Description

      PigStats.JobGraph currently provides an iterator. The rationale behind providing a List getter is that it simply provides a lot more methods than an iterator. One could do that in the caller code, but providing this helper in the API would be beneficial. For eg, a framework that is used by clients could initiate several pig scripts/store commands at once. At the framework layer, you might want to be able to determine the number of MR jobs in total spawned by these multiple scripts and query stats on those. That's just one use-case, there could be more methods on List that a user could be interested in.

      1. PIG-2964.patch
        4 kB
        Prashant Kommireddi
      2. PIG-2964_1.patch
        6 kB
        Prashant Kommireddi

        Activity

        Bill Graham made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Bill Graham made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Prashant Kommireddi made changes -
        Attachment PIG-2964_1.patch [ 12548761 ]
        Bill Graham made changes -
        Patch Info Patch Available [ 10042 ]
        Prashant Kommireddi made changes -
        Description The rationale behind providing a List getter is that it simply provides a lot more methods than an iterator. One could do that in the caller code, providing this helper in the API would be beneficial. For eg, a framework that is used by clients could initiate several pig scripts/store commands at once. At the framework layer, you might want to be able to determine the number of MR jobs in total spawned by these multiple scripts and query stats on those. That's just one use-case, there could be more methods on List that a user could be interested in. PigStats.JobGraph currently provides an iterator. The rationale behind providing a List getter is that it simply provides a lot more methods than an iterator. One could do that in the caller code, but providing this helper in the API would be beneficial. For eg, a framework that is used by clients could initiate several pig scripts/store commands at once. At the framework layer, you might want to be able to determine the number of MR jobs in total spawned by these multiple scripts and query stats on those. That's just one use-case, there could be more methods on List that a user could be interested in.
        Prashant Kommireddi made changes -
        Field Original Value New Value
        Attachment PIG-2964.patch [ 12548717 ]
        Prashant Kommireddi created issue -

          People

          • Assignee:
            Prashant Kommireddi
            Reporter:
            Prashant Kommireddi
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development