Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1651

Too long fetcher default retries

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.9.0, 0.10.0, 0.10.1
    • Fix Version/s: 0.11.0
    • Component/s: Data Shuffle
    • Labels:
      None

      Description

      The fetcher is getting an intermediate file from PullServer. fetcher will retry, when fails.
      Currently, maximum timeout is task-retry(3) * fetch-retry(20) * timeout(120 sec)
      I suggest that SHUFFLE_FETCHER_READ_RETRY_MAX_NUM change to 2

      SHUFFLE_FETCHER_READ_TIMEOUT("tajo.shuffle.fetcher.read.timeout-sec", 120)
      SHUFFLE_FETCHER_READ_RETRY_MAX_NUM("tajo.shuffle.fetcher.read.retry.max-num", 20)
      

        Attachments

          Activity

            People

            • Assignee:
              jhkim Jinho Kim
              Reporter:
              jhkim Jinho Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: