Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9152

Get input/output error while copying 800 small files to NFS Gateway mount point

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • 2.7.1
    • None
    • nfs

    Description

      We have around 800 3-5K files on local file system, we have nfs gateway mounted on /hdfs/, when we tried to copy these files to HDFS by

      cp ~/userdata/ /hdfs/user/cqdemo/demo3.data/*

      most of files are failed because of

      cp: writing `/hdfs/user/cqdemo/demo3.data/TRAFF_201408011220.csv': Input/output error
      cp: writing `/hdfs/user/cqdemo/demo3.data/TRAFF_201408011221.csv': Input/output error
      cp: writing `/hdfs/user/cqdemo/demo3.data/TRAFF_201408011222.csv': Input/output error

      for same set of files, I tried to use hadoop dfs -put command to do the copy, it works fine.

      Attachments

        1. NNErrors.log
          7 kB
          Weiwei Yang
        2. DNErrors.log
          6 kB
          Weiwei Yang

        Activity

          People

            cheersyang Weiwei Yang
            cheersyang Weiwei Yang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: