Uploaded image for project: 'Crunch (Retired)'
  1. Crunch (Retired)
  2. CRUNCH-68

Crunch examples don't accept generic tool arguments

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.3.0
    • 0.4.0
    • Core
    • None

    Description

      Currently all crunch examples have the following code:

          if (args.length != 3) {
            System.err.println();
            System.err.println("Usage: " + this.getClass().getName() + " [generic options] input output");
            System.err.println();
            GenericOptionsParser.printGenericCommandUsage(System.err);
            return 1;
          }
      

      this is incorrect since run() gets to see all arguments even generic ones and thus you can't predict the value of
      args.length.
      This is also, unfortunately a major blocker, for using Crunch with Hadoop 2 because of a MAPREDUCE-4068.

      Essentially at this point a combination of MAPREDUCE-4068 and inability to pass -libjars makes Crunch example DOA for Hadoop 2 clusters.

      Attachments

        1. CRUNCH-68-Fix-command-line-parser-for-examples.patch
          9 kB
          Matthias Friedrich
        2. CRUNCH-68-v2.patch
          7 kB
          Matthias Friedrich

        Issue Links

          Activity

            People

              mafr Matthias Friedrich
              rvs Roman Shaposhnik
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: