Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-2029

Mark.checkMark returns empty string when null is expected with mongodb storage

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.3
    • 2.3.1
    • storage
    • None

    Description

      Gora mongodb backend returns empty Utf8 for null field values.
      This leads to Mark.checkMark never returns null, so multiple checks on null fail e.g. in DbUpdateMapper, GeneratorMapper etc.

      Temporal fix is to check whether value is null or empty

      See patch
      https://github.com/newpointer/nutch/commit/4bdc0bab39ede7c01ee057c3429f5f0e90d5e48f

      and related gora issue
      https://issues.apache.org/jira/browse/GORA-423

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-2009 Fetcher does not work with batchID

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. GORA-423 BSONDecorator returns empty string for null field value

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              AlexanderYastrebov Alexander Yastrebov
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: