Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-1822

Search Query Builder and Faceted Search in Atlas



    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • atlas-core, atlas-webui
    • None


      Current search experience in Atlas UI is pretty basic and any advanced searches require knowledge of DSL that might be difficult for business users.

      As a data steward or data consumer, I need an easy and intuitive way to perform faceted searches on entities, classifications, relationships, and business glossaries and filter the results based on a combination of parameters so I can navigate and locate assets for curation and in order to take any governance actions. I also need to be able to save my searches and filters and rerun them dynamically against the latest state of the enterprise metadata catalog in Atlas.
      Implementation considerations:

      1. For business users, there should be default filters provided based on commonly used criteria in the search experience
      2. Any search results should only show metadata of data assets that user has permission to view, based upon authorization policies (via Ranger)
      3. Search facets need to be based on search conditions and should allow for sequence of AND, OR and NOT operations with multiple search conditions
      4. Search facets details (should allow for combinations of any or all of the following):
      • Asset type (entity types)
      • Attribute value checker (should allow for combinations of range checks, ordinality, exact match, numeric, string and date comparisons, single or muliple values, category checks, nulls)
      • Created time
      • Updated time
      • Size (where relevant for e.g. HDFS files)
      • Deleted/Active status
      • Owner
      • Custom property values
      • File format
      • Asset name
      • Physical storage context: Datalake/cluster or datacenter holding the asset
      • Classification
      • Glossary/taxonomy association


      1. Searches should be able to be saved and scoped to a particular business catalog or asset type or namespace (when multi-tenancy is supported by Atlas in the future)
      2. Once search results are available, user should be able to filter by any of the facets.


        Issue Links

          Basic search improvement in use of Solr index for attribute filtering Sub-task Resolved Madhan Neethiraj
          Search API: Work with Tag attributes when query and entity filters are specified Sub-task Resolved Apoorv Naik
          basic-search: numeric tag-attribute filtering fails with java.lang.ClassCastException Sub-task Resolved Madhan Neethiraj
          Regression : Empty results fetched from GET Basic search query Sub-task Resolved Sharmadha S
          Basic query with entity and tag filters : Providing invalid tag name for classification returns all entities matching typename/query Sub-task Resolved Apoorv Naik
          Regression : Entity,Tag filter fetches empty results when applied on an enum attribute. Sub-task Resolved Apoorv Naik
          Regression: Search fails when filter contains a boolean attribute and a string attribute with special characters Sub-task Resolved Madhan Neethiraj
          Regression: Basic search performance Sub-task Resolved Apoorv Naik
          Basic search issues due to Titan Solr schema Sub-task Resolved Apoorv Naik
          Basic search - Contains clause issues Sub-task Resolved Apoorv Naik
          Search using entity and trait attributes - "#" in string attribute filter doesn't fetch results Sub-task Resolved Apoorv Naik
          Basic query with entity and tag filters : Invalid filter keys for type and tags attributes are ignored and fetches all entities of the type / associated to the tag Sub-task Resolved Apoorv Naik
          Inconsistency in basic search results due to case sensitivity of type names Sub-task Resolved Apoorv Naik
          Support for Saving Searches Sub-task Resolved Ashutosh Mestry
          Saved Search: Introduce BASIC and ADVANCE Search Types During Save Sub-task Resolved Ashutosh Mestry
          UI to support search-history and favorites Sub-task Resolved Keval Bhatt



              madhan Madhan Neethiraj
              srikvenk Srikanth Venkat
              1 Vote for this issue
              2 Start watching this issue