Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-12343

Allow set file.replication in Yarn Configuration

    XMLWordPrintableJSON

    Details

      Description

      Currently, FlinkYarnSessionCli upload jars into hdfs with default 3 replications. From our production experience, we find that 3 replications will block big job (256 containers) to launch, when the HDFS is slow due to big workload for batch pipelines. Thus, we want to make the factor customizable from FlinkYarnSessionCli by adding an option.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ZhenqiuHuang Zhenqiu Huang
                Reporter:
                ZhenqiuHuang Zhenqiu Huang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m