Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-1822

Search Query Builder and Faceted Search in Atlas

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: atlas-core, atlas-webui
    • Labels:
      None

      Description

      Current search experience in Atlas UI is pretty basic and any advanced searches require knowledge of DSL that might be difficult for business users.

      As a data steward or data consumer, I need an easy and intuitive way to perform faceted searches on entities, classifications, relationships, and business glossaries and filter the results based on a combination of parameters so I can navigate and locate assets for curation and in order to take any governance actions. I also need to be able to save my searches and filters and rerun them dynamically against the latest state of the enterprise metadata catalog in Atlas.
      Implementation considerations:

      1. For business users, there should be default filters provided based on commonly used criteria in the search experience
      2. Any search results should only show metadata of data assets that user has permission to view, based upon authorization policies (via Ranger)
      3. Search facets need to be based on search conditions and should allow for sequence of AND, OR and NOT operations with multiple search conditions
      4. Search facets details (should allow for combinations of any or all of the following):
      • Asset type (entity types)
      • Attribute value checker (should allow for combinations of range checks, ordinality, exact match, numeric, string and date comparisons, single or muliple values, category checks, nulls)
      • Created time
      • Updated time
      • Size (where relevant for e.g. HDFS files)
      • Deleted/Active status
      • Owner
      • Custom property values
      • File format
      • Asset name
      • Physical storage context: Datalake/cluster or datacenter holding the asset
      • Classification
      • Glossary/taxonomy association

      Note:

      1. Searches should be able to be saved and scoped to a particular business catalog or asset type or namespace (when multi-tenancy is supported by Atlas in the future)
      2. Once search results are available, user should be able to filter by any of the facets.

        Attachments

          Issue Links

          1.
          Basic search improvement in use of Solr index for attribute filtering Sub-task Resolved Madhan Neethiraj
          2.
          Search API: Work with Tag attributes when query and entity filters are specified Sub-task Resolved Apoorv Naik
          3.
          basic-search: numeric tag-attribute filtering fails with java.lang.ClassCastException Sub-task Resolved Madhan Neethiraj
          4.
          Regression : Empty results fetched from GET Basic search query Sub-task Resolved Sharmadha S
          5.
          Basic query with entity and tag filters : Providing invalid tag name for classification returns all entities matching typename/query Sub-task Resolved Apoorv Naik
          6.
          Regression : Entity,Tag filter fetches empty results when applied on an enum attribute. Sub-task Resolved Apoorv Naik
          7.
          Regression: Search fails when filter contains a boolean attribute and a string attribute with special characters Sub-task Resolved Madhan Neethiraj
          8.
          Regression: Basic search performance Sub-task Resolved Apoorv Naik
          9.
          Basic search issues due to Titan Solr schema Sub-task Resolved Apoorv Naik
          10.
          Basic search - Contains clause issues Sub-task Resolved Apoorv Naik
          11.
          Search using entity and trait attributes - "#" in string attribute filter doesn't fetch results Sub-task Resolved Apoorv Naik
          12.
          Basic query with entity and tag filters : Invalid filter keys for type and tags attributes are ignored and fetches all entities of the type / associated to the tag Sub-task Resolved Apoorv Naik
          13.
          Inconsistency in basic search results due to case sensitivity of type names Sub-task Resolved Apoorv Naik
          14.
          Support for Saving Searches Sub-task Resolved Ashutosh Mestry
          15.
          Saved Search: Introduce BASIC and ADVANCE Search Types During Save Sub-task Resolved Ashutosh Mestry
          16.
          UI to support search-history and favorites Sub-task Resolved Keval Bhatt

            Activity

              People

              • Assignee:
                madhan Madhan Neethiraj
                Reporter:
                srikvenk Srikanth Venkat
              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: