Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-2869

When using non-default FS as the working-dir, Kylin puts large metadata file to default FS

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Invalid
    • None
    • None
    • Metadata
    • None

    Description

      Azure HDInsight uses WASB as the default FS; I set using a HDFS full qualified name as "kylin.env.hdfs-working-dir", when build a cube, a large dict file was put to the DFS. This should be a bug in HBaseConnection.newHBaseConfiguration(), it overwrites the default fs setting only when user set "kylin.storage.hbase.cluster-fs". But when user set a non-default fs for working dir, it did nothing.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            shaofengshi Shao Feng Shi
            shaofengshi Shao Feng Shi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment