Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
5.0-alpha
-
None
-
None
Description
When using http://host:port/kylin/api/async_query/\{query_id}/result_download? to get asynchronous query result, out-of-memory error might occur. The reason is the formatting process while downloading the result needs read & write, and there is batch processing rather than streaming processing. Therefore, a refactor is needed for async query. The main idea of revision is to move the formatting from downloading result from HDFS to processing & saving query result on HDFS, and use streaming read & write instead.
The details of design are in the attached file.