Pig
  1. Pig
  2. PIG-142

Early detection of issues (by Parser)

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.2.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      Pig and Grunt

      Description

      If we can detect parse/lexical/syntax/etc. issues before running a script we can save user/cluster time. Occasionally this results in a long script failing in the middle because of a simple detectable typo and wasting time/processing power. This issue can serve as holder of several examples and levels we can tackle this.

      There were some discussions regarding having save-points/check-points so script can resume from a failed point. That goes in a separate issue.

      Please go ahead and add your examples.

        Issue Links

          Activity

          Hide
          Olga Natkovich added a comment -

          I believe this has been addressed with the latest code.

          Show
          Olga Natkovich added a comment - I believe this has been addressed with the latest code.
          Hide
          Pi Song added a comment -

          Ben,

          I've been trying to push the same concept to the new type branch to make it easy to plug-in new validators.

          We will have a type checking validator, and possibly an optional mock execution test.

          Show
          Pi Song added a comment - Ben, I've been trying to push the same concept to the new type branch to make it easy to plug-in new validators. We will have a type checking validator, and possibly an optional mock execution test.
          Hide
          Benjamin Francisoud added a comment -

          May be we could take advantage of apache commons validator for this ?

          Show
          Benjamin Francisoud added a comment - May be we could take advantage of apache commons validator for this ?
          Hide
          Amir Youssefi added a comment -

          Pi,

          You are welcome to create Sub-Tasks for this JIRA .

          Show
          Amir Youssefi added a comment - Pi, You are welcome to create Sub-Tasks for this JIRA .
          Hide
          Pi Song added a comment -

          To make this simpler, I would like to propose splitting validation logic from parser and make the validation extensible.
          I will come up with a proper proposal as soon as possible.

          Show
          Pi Song added a comment - To make this simpler, I would like to propose splitting validation logic from parser and make the validation extensible. I will come up with a proper proposal as soon as possible.
          Hide
          Amir Youssefi added a comment -

          type check can be added when Pig types are implemented.

          Show
          Amir Youssefi added a comment - type check can be added when Pig types are implemented.

            People

            • Assignee:
              Unassigned
              Reporter:
              Amir Youssefi
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development