Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12164

Remove jdbc stats collection mechanism

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.0.0
    • Component/s: Statistics
    • Labels:
    • Hadoop Flags:
      Incompatible change

      Description

      Though there are some deployments using it, usually its painful to setup since a valid hive-site.xml is needed on all task nodes (containing connection details) and for large tasks (with thousands of tasks) results in a scalability issue with all of them hammering DB at nearly same time.
      Because of these pain points alternative stats collection mechanism were added. FS stats based system is default for some time.
      We should remove jdbc stats collection mechanism as it needlessly adds complexity in TS and FS operators w.r.t key handling.

        Attachments

        1. HIVE-12164.patch
          72 kB
          Ashutosh Chauhan
        2. HIVE-12164.1.patch
          79 kB
          Ashutosh Chauhan
        3. HIVE-12164.2.patch
          85 kB
          Ashutosh Chauhan
        4. HIVE-12164.3.patch
          88 kB
          Ashutosh Chauhan

          Issue Links

            Activity

              People

              • Assignee:
                ashutoshc Ashutosh Chauhan
                Reporter:
                ashutoshc Ashutosh Chauhan
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: