Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3193

FileInputFormat doesn't read files recursively in the input path dir

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.2, 2.0.0-alpha, 3.0.0
    • Fix Version/s: 0.23.10, 2.1.1-beta
    • Component/s: mrv1, mrv2
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      java.io.FileNotFoundException is thrown,if input file is more than one folder level deep and the job is getting failed.
      Example:Input file is /r1/r2/input.txt

      1. MAPREDUCE-3193.patch
        6 kB
        Devaraj K
      2. MAPREDUCE-3193-1.patch
        8 kB
        Devaraj K
      3. MAPREDUCE-3193-2.patch
        13 kB
        Devaraj K
      4. MAPREDUCE-3193.security.patch
        15 kB
        Devaraj K
      5. MAPREDUCE-3193-2.patch
        13 kB
        Devaraj K
      6. MAPREDUCE-3193-3.patch
        12 kB
        Devaraj K
      7. MAPREDUCE-3193-4.patch
        12 kB
        Devaraj K
      8. MAPREDUCE-3193-5.patch
        12 kB
        Devaraj K

        Issue Links

          Activity

          Ramgopal N created issue -
          Devaraj K made changes -
          Field Original Value New Value
          Assignee Devaraj K [ devaraj.k ]
          Devaraj K made changes -
          Attachment MAPREDUCE-3193.patch [ 12499639 ]
          Devaraj K made changes -
          Attachment MAPREDUCE-3193-1.patch [ 12499866 ]
          Devaraj K made changes -
          Summary NextGen Mapreduce framework is not able to read the job input recursively.Input is read only for one folder level deep FileInputFormat doesn't read files recursively in the input path dir
          Affects Version/s 0.24.0 [ 12317654 ]
          Affects Version/s 0.23.0 [ 12315570 ]
          Devaraj K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.24.0 [ 12317654 ]
          Mahadev konar made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Devaraj K made changes -
          Attachment MAPREDUCE-3193-2.patch [ 12505104 ]
          Attachment MAPREDUCE-3193.security.patch [ 12505105 ]
          Devaraj K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Devaraj K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Devaraj K made changes -
          Attachment MAPREDUCE-3193-2.patch [ 12505206 ]
          Devaraj K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Devaraj K made changes -
          Fix Version/s 1.1.0 [ 12317960 ]
          Devaraj K made changes -
          Fix Version/s 0.24.0 [ 12317654 ]
          Fix Version/s 1.1.0 [ 12317960 ]
          Affects Version/s 1.0.2 [ 12320047 ]
          Affects Version/s 2.0.0 [ 12320354 ]
          Affects Version/s 3.0.0 [ 12320355 ]
          Affects Version/s 0.24.0 [ 12317654 ]
          Component/s mrv1 [ 12315344 ]
          Devaraj K made changes -
          Affects Version/s 0.23.2 [ 12319851 ]
          Devaraj K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Devaraj K made changes -
          Attachment MAPREDUCE-3193-3.patch [ 12530373 ]
          Devaraj K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Devaraj K made changes -
          Target Version/s 2.0.1-alpha, 3.0.0 [ 12321442, 12320355 ]
          Devaraj K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Devaraj K made changes -
          Attachment MAPREDUCE-3193-4.patch [ 12587785 ]
          Devaraj K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 1.0.2 [ 12320047 ]
          Devaraj K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Devaraj K made changes -
          Attachment MAPREDUCE-3193-5.patch [ 12590385 ]
          Devaraj K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Jason Lowe made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 3.0.0 [ 12320355 ]
          Fix Version/s 2.3.0 [ 12324590 ]
          Fix Version/s 0.23.10 [ 12324662 ]
          Resolution Fixed [ 1 ]
          Jason Lowe made changes -
          Fix Version/s 2.1.1-beta [ 12324808 ]
          Fix Version/s 2.3.0 [ 12324590 ]
          Prasanth Jayachandran made changes -
          Link This issue relates to HIVE-4750 [ HIVE-4750 ]
          Jason Lowe made changes -
          Link This issue is duplicated by MAPREDUCE-1577 [ MAPREDUCE-1577 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Allen Wittenauer made changes -
          Fix Version/s 3.0.0 [ 12320355 ]

            People

            • Assignee:
              Devaraj K
              Reporter:
              Ramgopal N
            • Votes:
              3 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development