Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2139 Fast copy for HDFS.
  3. HDFS-16760

Support a block level inputFormat for RetriableFileFastCopyCommand

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      RetriableFileFastCopyCommand needs a block level inputFormat to deal with the data skew problem at the block level.

      If the current existed inputFormats have the similar function, can modify them to meet this condition first.

      Attachments

        Activity

          People

            haiyang Hu Haiyang Hu
            xuzq_zander ZanderXu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: