Linked Applications
Loading…
Dashboards
Projects
Issues
Help
Jira Core help
Keyboard Shortcuts
About Jira
Jira Credits
Log In
Spark
SPARK-5463
Improve Parquet support (reliability, performance, and error messages)
Log In
Export
XML
Word
Printable
JSON
Details
Type:
Improvement
Status:
Resolved
Priority:
Blocker
Resolution:
Fixed
Affects Version/s:
1.2.0
,
1.2.1
,
1.2.2
,
1.3.0
Fix Version/s:
None
Component/s:
SQL
Labels:
None
Target Version/s:
1.6.0
Attachments
Options
Show All
Show Open
Bulk operation
Open issue navigator
Sub-Tasks
1.
NPE with new Parquet Filters
Resolved
Thomas Omans
2.
And predicates are not properly pushed down
Resolved
Thomas Omans
3.
Parquet filter pushdown is not enabled when parquet.task.side.metadata is set to true (default value)
Closed
Unassigned
4.
Data source version of Parquet doesn't push down And filters properly
Resolved
Unassigned
5.
Cannot use partition columns in where clause when Parquet filter push-down is enabled
Resolved
Cheng Lian
6.
Upgrade Parquet to 1.7
Resolved
Thomas Omans
7.
Parquet should throw AnalysisException during setup for data type/name related failures
Resolved
Reynold Xin
8.
Turn off noisy log output produced by Parquet 1.7.0
Resolved
Cheng Lian
9.
Accelerate ParquetRelation2 metadata discovery
Resolved
Cheng Lian
10.
Cleanup FilteringParquetRowInputFormat
Resolved
Cheng Lian
11.
Better error when saving to parquet with duplicate columns
Resolved
Unassigned
12.
Test Parquet interoperability and compatibility with other libraries/systems
Resolved
Cheng Lian
13.
Parquet : Writing data to S3 very slowly
Resolved
Unassigned
14.
Turn on Parquet filter push-down by default
Resolved
Cheng Lian
Activity
People
Assignee:
Cheng Lian
Reporter:
Cheng Lian
Votes:
1
Vote for this issue
Watchers:
11
Start watching this issue
Dates
Created:
28/Jan/15 21:31
Updated:
03/Nov/15 10:22
Resolved:
03/Nov/15 10:22