Uploaded image for project: 'Crunch (Retired)'
  1. Crunch (Retired)
  2. CRUNCH-408

HFileSource does not estimate the size of input correctly when there is a wildcard in path

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.2, 0.10.0
    • 0.10.0, 0.8.3
    • None
    • None

    Description

      The cause is that it calls FileSystem#listStatus rather than FileSystem#globStatus to retrieve the list of files under the given path. So the fix is straight forward.

      Attachments

        1. crunch-408.patch
          1 kB
          Chao Shi
        2. CRUNCH-408b.patch
          2 kB
          Josh Wills

        Issue Links

          Activity

            People

              Unassigned Unassigned
              stepinto Chao Shi
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment