Uploaded image for project: 'Sentry'
  1. Sentry
  2. SENTRY-2302

Optimize HDFS ACL Synchronization.

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.1.0
    • Fix Version/s: 2.1
    • Component/s: Sentry
    • Labels:
      None

      Description

      Optimize the time taken for HDFS-SYNC full snapshot.

      1. Decrease total time taken for HDFS ACL synchronization.
      2. Reduce/Avoid the duration HMS threads are blocked by synchronizing the notifications with sentry.

      Here are the time intensive operations in the hdfs-acl synchronization ordered by time taken.

      1. Fetching full snapshot from HMS.
      2. Persisting the snapshot in the database.
      3. Retrieving full snapshot from database.

        Attachments

          Activity

            People

            • Assignee:
              kkalyan Krishna Kalyan
              Reporter:
              kkalyan Krishna Kalyan
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: