Uploaded image for project: 'Atlas'
  1. Atlas
  2. ATLAS-1822

Search Query Builder and Faceted Search in Atlas

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • atlas-core, atlas-webui
    • None

    Description

      Current search experience in Atlas UI is pretty basic and any advanced searches require knowledge of DSL that might be difficult for business users.

      As a data steward or data consumer, I need an easy and intuitive way to perform faceted searches on entities, classifications, relationships, and business glossaries and filter the results based on a combination of parameters so I can navigate and locate assets for curation and in order to take any governance actions. I also need to be able to save my searches and filters and rerun them dynamically against the latest state of the enterprise metadata catalog in Atlas.
      Implementation considerations:

      1. For business users, there should be default filters provided based on commonly used criteria in the search experience
      2. Any search results should only show metadata of data assets that user has permission to view, based upon authorization policies (via Ranger)
      3. Search facets need to be based on search conditions and should allow for sequence of AND, OR and NOT operations with multiple search conditions
      4. Search facets details (should allow for combinations of any or all of the following):
      • Asset type (entity types)
      • Attribute value checker (should allow for combinations of range checks, ordinality, exact match, numeric, string and date comparisons, single or muliple values, category checks, nulls)
      • Created time
      • Updated time
      • Size (where relevant for e.g. HDFS files)
      • Deleted/Active status
      • Owner
      • Custom property values
      • File format
      • Asset name
      • Physical storage context: Datalake/cluster or datacenter holding the asset
      • Classification
      • Glossary/taxonomy association

      Note:

      1. Searches should be able to be saved and scoped to a particular business catalog or asset type or namespace (when multi-tenancy is supported by Atlas in the future)
      2. Once search results are available, user should be able to filter by any of the facets.

      Attachments

        Issue Links

        1.
        Basic search improvement in use of Solr index for attribute filtering Sub-task Resolved Madhan Neethiraj Actions
        2.
        Search API: Work with Tag attributes when query and entity filters are specified Sub-task Resolved Apoorv Naik Actions
        3.
        basic-search: numeric tag-attribute filtering fails with java.lang.ClassCastException Sub-task Resolved Madhan Neethiraj Actions
        4.
        Regression : Empty results fetched from GET Basic search query Sub-task Resolved Sharmadha S Actions
        5.
        Basic query with entity and tag filters : Providing invalid tag name for classification returns all entities matching typename/query Sub-task Resolved Apoorv Naik Actions
        6.
        Regression : Entity,Tag filter fetches empty results when applied on an enum attribute. Sub-task Resolved Apoorv Naik Actions
        7.
        Regression: Search fails when filter contains a boolean attribute and a string attribute with special characters Sub-task Resolved Madhan Neethiraj Actions
        8.
        Regression: Basic search performance Sub-task Resolved Apoorv Naik Actions
        9.
        Basic search issues due to Titan Solr schema Sub-task Resolved Apoorv Naik Actions
        10.
        Basic search - Contains clause issues Sub-task Resolved Apoorv Naik Actions
        11.
        Search using entity and trait attributes - "#" in string attribute filter doesn't fetch results Sub-task Resolved Apoorv Naik Actions
        12.
        Basic query with entity and tag filters : Invalid filter keys for type and tags attributes are ignored and fetches all entities of the type / associated to the tag Sub-task Resolved Apoorv Naik Actions
        13.
        Inconsistency in basic search results due to case sensitivity of type names Sub-task Resolved Apoorv Naik Actions
        14.
        Support for Saving Searches Sub-task Resolved Ashutosh Mestry Actions
        15.
        Saved Search: Introduce BASIC and ADVANCE Search Types During Save Sub-task Resolved Ashutosh Mestry Actions
        16.
        UI to support search-history and favorites Sub-task Resolved Keval Bhatt Actions

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            madhan Madhan Neethiraj
            srikvenk Srikanth Venkat

            Dates

              Created:
              Updated:

              Slack

                Issue deployment