Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-488

Data fetcher doesn't close small file in shuffle

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: Data Shuffle
    • Labels:
      None

      Description

      If a intermediate file size less than the chunk size, it does not close.

        Activity

        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-build #7 (See https://builds.apache.org/job/Tajo-master-build/7/)
        TAJO-488: Data fetcher doesn't close small file in shuffle. (jinho) (jinossy: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=c4b81569ad2a1ee5fa1695016a7aded6c9f7e512)

        • CHANGES.txt
        • tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/worker/Fetcher.java
        • tajo-core/tajo-core-pullserver/src/main/java/org/apache/tajo/pullserver/TajoPullServerService.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-build #7 (See https://builds.apache.org/job/Tajo-master-build/7/ ) TAJO-488 : Data fetcher doesn't close small file in shuffle. (jinho) (jinossy: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=c4b81569ad2a1ee5fa1695016a7aded6c9f7e512 ) CHANGES.txt tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/worker/Fetcher.java tajo-core/tajo-core-pullserver/src/main/java/org/apache/tajo/pullserver/TajoPullServerService.java
        Hide
        jhkim Jinho Kim added a comment -

        This issue got +1 from reviewboard.
        I've just committed it to master branch.

        Show
        jhkim Jinho Kim added a comment - This issue got +1 from reviewboard. I've just committed it to master branch.
        Hide
        jhkim Jinho Kim added a comment - - edited

        Created a review request against branch master in reviewboard
        https://reviews.apache.org/r/16748/

        Show
        jhkim Jinho Kim added a comment - - edited Created a review request against branch master in reviewboard https://reviews.apache.org/r/16748/

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            jhkim Jinho Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development