Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Invalid
    • Affects Version/s: 0.20.2
    • Fix Version/s: None
    • Component/s: job submission
    • Labels:
      None

      Description

      It would be useful to be able to submit the same job and have it chroot the output to a different base directory before execution. This would allow for input to be the same, but output different for the same job over multiple runs (potentially by different users).

        Activity

        Hide
        Arun C Murthy added a comment -

        By 'output' you mean on HDFS?

        Show
        Arun C Murthy added a comment - By 'output' you mean on HDFS?
        Hide
        Allen Wittenauer added a comment -

        Yes. I'm not sure whether this should be a HDFS or MR bug tho. So I started here.

        Show
        Allen Wittenauer added a comment - Yes. I'm not sure whether this should be a HDFS or MR bug tho. So I started here.
        Hide
        Arun C Murthy added a comment -

        Why doesn't '-output' switch (-Dmapred.output.dir) suffice then?

        Show
        Arun C Murthy added a comment - Why doesn't '-output' switch (-Dmapred.output.dir) suffice then?
        Hide
        Allen Wittenauer added a comment -

        Oooo. Maybe. I'll see if that works for the use case these guys have. Thanks. I didn't know that existed.

        Show
        Allen Wittenauer added a comment - Oooo. Maybe. I'll see if that works for the use case these guys have. Thanks. I didn't know that existed.
        Hide
        Arun C Murthy added a comment -

        No worries, once your highness is satisfied please close this one!

        Show
        Arun C Murthy added a comment - No worries, once your highness is satisfied please close this one!
        Hide
        Allen Wittenauer added a comment -

        Muhaha! I'm quite stunned to see I'm held in such high regard!

        Anyway, I've been told to close this out, as the people who really wanted to do this say this will work.

        Thanks.

        Show
        Allen Wittenauer added a comment - Muhaha! I'm quite stunned to see I'm held in such high regard! Anyway, I've been told to close this out, as the people who really wanted to do this say this will work. Thanks.

          People

          • Assignee:
            Unassigned
            Reporter:
            Allen Wittenauer
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development