Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-2375

Upgrade the code base from org.apache.hadoop.mapred to org.apache.hadoop.mapreduce

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.13
    • 1.15
    • deployment
    • None

    Description

      Nutch is still using the deprecated org.apache.hadoop.mapred dependency which has been deprecated. It need to be updated to org.apache.hadoop.mapreduce dependency.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2517 mergesegs corrupts segment data

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2518 Must check return value of job.waitForCompletion()

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2550 Fetcher fails to follow redirects

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2551 NullPointerException in generator

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2569 ClassNotFoundException when running in (pseudo-)distributed mode

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2544 Nutch 1.15 no longer compatible with AWS EMR and S3

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2552 CrawlDbReader -topN fails

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2553 Fetcher not to modify URLs to be fetched

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2597 NPE in updatehostdb

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2652 Fetcher launches more fetch tasks than fetch lists

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2535 CrawlDbReader -stats: ClassCastException

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2572 HostDb: updatehostdb does not set values

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2590 SegmentReader -get fails

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2571 SegmentReader -list fails to read segment

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2717 Generator cannot open hostDB

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. NUTCH-2566 Fix exception log messages

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Closed
          fixes

          Improvement - An improvement or enhancement to an existing feature or task. NUTCH-1380 Fetcher reducer not to configure filter/normalizers

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          supercedes

          Sub-task - The sub-task of the issue NUTCH-1223 Migrate WebGraph to MapReduce API

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue NUTCH-1224 Migrate FreeGenerator to MapReduce API

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue NUTCH-1226 Migrate CrawlDbReader to MapReduce API

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-1783 Cleanup temp folders in case of failures

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Task - A task that needs to be done. NUTCH-1219 Upgrade all jobs to new MapReduce API

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #188

          Web Link GitHub Pull Request #221

          Activity

            People

              lewismc Lewis John McGibbney
              omkar20895 Omkar Reddy
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: