Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2477

TestBuiltin testLFText/testSFPig failing against 23 due to invalid test setup -- InvalidInputException

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.9.2
    • 0.9.2, 0.10.0, 0.11
    • None
    • None
    • ubuntu, hadoop23

    • Reviewed

    Description

      I see the following exception when running against hadoop 23: (all test-commit tests pass except for these two)

      org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/var/lib/hudson/workspace/CDH4-Pig-0.9.2-test-commit/testSFPig-output.txt
      	at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:243)
      	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
      	at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:269)
      	at org.apache.pig.impl.io.ReadToEndLoader.init(ReadToEndLoader.java:154)
      	at org.apache.pig.impl.io.ReadToEndLoader.<init>(ReadToEndLoader.java:116)
      	at org.apache.pig.test.TestBuiltin.testSFPig(TestBuiltin.java:2177)
      

      This happens in both testLFText/testSFPig.

      Looking at these two tests it seems that toConfiguration is being called improperly, I have a patch (momentarily) that will address this similar to:

      -                toConfiguration(new Properties()), "testLFTest-input1.txt", 0);
      +            toConfiguration(cluster.getProperties()), "testLFTest-input1.txt", 0);
      

      Attachments

        1. PIG-2477.patch
          2 kB
          Patrick D. Hunt

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            phunt Patrick D. Hunt
            phunt Patrick D. Hunt
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment