Nutch
  1. Nutch
  2. NUTCH-1351

DomainStatistics to aggregate by TLD

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.5
    • Fix Version/s: 1.6
    • Component/s: None
    • Labels:
      None
    • Patch Info:
      Patch Available

      Description

      The DomainStatistics tool aggregates counts by host, domain or suffix but tld is missing.

        Activity

        Hide
        Markus Jelsma added a comment -

        Patch for 1.6. It adds a new method to URLUtil to obtain the TLD for a given URL.

        Show
        Markus Jelsma added a comment - Patch for 1.6. It adds a new method to URLUtil to obtain the TLD for a given URL.
        Hide
        Markus Jelsma added a comment -

        Committed for 1.6 in rev. 1347747.

        Show
        Markus Jelsma added a comment - Committed for 1.6 in rev. 1347747.
        Hide
        Hudson added a comment -

        Integrated in nutch-trunk-maven #299 (See https://builds.apache.org/job/nutch-trunk-maven/299/)
        NUTCH-1351 DomainStatistics to aggregate by TLD (Revision 1347747)

        Result = SUCCESS
        markus :
        Files :

        • /nutch/trunk/CHANGES.txt
        • /nutch/trunk/src/java/org/apache/nutch/util/URLUtil.java
        • /nutch/trunk/src/java/org/apache/nutch/util/domain/DomainStatistics.java
        Show
        Hudson added a comment - Integrated in nutch-trunk-maven #299 (See https://builds.apache.org/job/nutch-trunk-maven/299/ ) NUTCH-1351 DomainStatistics to aggregate by TLD (Revision 1347747) Result = SUCCESS markus : Files : /nutch/trunk/CHANGES.txt /nutch/trunk/src/java/org/apache/nutch/util/URLUtil.java /nutch/trunk/src/java/org/apache/nutch/util/domain/DomainStatistics.java
        Hide
        Hudson added a comment -

        Integrated in Nutch-trunk #1865 (See https://builds.apache.org/job/Nutch-trunk/1865/)
        NUTCH-1351 DomainStatistics to aggregate by TLD (Revision 1347747)

        Result = SUCCESS
        markus : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1347747
        Files :

        • /nutch/trunk/CHANGES.txt
        • /nutch/trunk/src/java/org/apache/nutch/util/URLUtil.java
        • /nutch/trunk/src/java/org/apache/nutch/util/domain/DomainStatistics.java
        Show
        Hudson added a comment - Integrated in Nutch-trunk #1865 (See https://builds.apache.org/job/Nutch-trunk/1865/ ) NUTCH-1351 DomainStatistics to aggregate by TLD (Revision 1347747) Result = SUCCESS markus : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1347747 Files : /nutch/trunk/CHANGES.txt /nutch/trunk/src/java/org/apache/nutch/util/URLUtil.java /nutch/trunk/src/java/org/apache/nutch/util/domain/DomainStatistics.java

          People

          • Assignee:
            Markus Jelsma
            Reporter:
            Markus Jelsma
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development