Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: v1.4.0
    • Fix Version/s: v1.5.0
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      Kite has released version 0.12.0 that fixes a bug in the flume sink. The sink can roll files on a timer, but in Kite < 0.12.0 this will create 0-record files for un-partitioned Datasets.

      1. FLUME-2345-1.patch
        0.7 kB
        Ryan Blue
      2. FLUME-2345-2.patch
        2 kB
        Ryan Blue
      3. FLUME-2345-3.patch
        2 kB
        Ryan Blue

        Activity

        Hide
        hshreedharan Hari Shreedharan added a comment -

        Ryan:

        Looks good. Can you also remove the explicit version in the morphline sink, and have it depend on the top-level pom version?

        Show
        hshreedharan Hari Shreedharan added a comment - Ryan: Looks good. Can you also remove the explicit version in the morphline sink, and have it depend on the top-level pom version?
        Hide
        rdblue Ryan Blue added a comment -

        Update to use kite.version from the root POM and unify versions between kite-data and kite-morphlines.

        Show
        rdblue Ryan Blue added a comment - Update to use kite.version from the root POM and unify versions between kite-data and kite-morphlines.
        Hide
        hshreedharan Hari Shreedharan added a comment -

        Looks like the Hadoop version bump broke this patch, could you please rebase?

        Show
        hshreedharan Hari Shreedharan added a comment - Looks like the Hadoop version bump broke this patch, could you please rebase?
        Hide
        rdblue Ryan Blue added a comment -

        This one should work.

        Show
        rdblue Ryan Blue added a comment - This one should work.
        Hide
        hshreedharan Hari Shreedharan added a comment -

        +1

        Show
        hshreedharan Hari Shreedharan added a comment - +1
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 1c8b8f5e9185d75c6b1cb06a617dfc08447935c9 in flume's branch refs/heads/trunk from Hari Shreedharan
        [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=1c8b8f5 ]

        FLUME-2345. Update to Kite 0.12.0 dependency

        (Ryan Blue via Hari Shreedharan)

        Show
        jira-bot ASF subversion and git services added a comment - Commit 1c8b8f5e9185d75c6b1cb06a617dfc08447935c9 in flume's branch refs/heads/trunk from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=1c8b8f5 ] FLUME-2345 . Update to Kite 0.12.0 dependency (Ryan Blue via Hari Shreedharan)
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit bf89b590ed8654153df7d04b67bdf14a3ed67d8e in flume's branch refs/heads/flume-1.5 from Hari Shreedharan
        [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=bf89b59 ]

        FLUME-2345. Update to Kite 0.12.0 dependency

        (Ryan Blue via Hari Shreedharan)

        Show
        jira-bot ASF subversion and git services added a comment - Commit bf89b590ed8654153df7d04b67bdf14a3ed67d8e in flume's branch refs/heads/flume-1.5 from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=bf89b59 ] FLUME-2345 . Update to Kite 0.12.0 dependency (Ryan Blue via Hari Shreedharan)
        Hide
        hshreedharan Hari Shreedharan added a comment -

        Committed! Thanks Ryan!

        Show
        hshreedharan Hari Shreedharan added a comment - Committed! Thanks Ryan!
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in flume-trunk #627 (See https://builds.apache.org/job/flume-trunk/627/)
        FLUME-2345. Update to Kite 0.12.0 dependency (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo/?p=flume.git&a=commit&h=1c8b8f5e9185d75c6b1cb06a617dfc08447935c9)

        • flume-ng-sinks/flume-ng-morphline-solr-sink/pom.xml
        • pom.xml
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in flume-trunk #627 (See https://builds.apache.org/job/flume-trunk/627/ ) FLUME-2345 . Update to Kite 0.12.0 dependency (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo/?p=flume.git&a=commit&h=1c8b8f5e9185d75c6b1cb06a617dfc08447935c9 ) flume-ng-sinks/flume-ng-morphline-solr-sink/pom.xml pom.xml

          People

          • Assignee:
            rdblue Ryan Blue
            Reporter:
            rdblue Ryan Blue
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development