[TOREE-534] SQL magic - Render as table like dataframe magic

• Type: Improvement
• Status: Open
• Priority: Trivial
• Resolution: Unresolved
• Fix Version/s: 0.4.0
• Assignee: Unassigned
• Reporter: Ricardo Gaspar
• Created: 22/Feb/23 17:33
• Updated: 18/Apr/23 20:15

Description

Would it be possible to render as table  (HTML like) as the dataframe magic (%%dataframe) shows the results?

Based on the documentation examples: https://github.com/apache/incubator-toree/blob/5b19aac2e56a56d35c888acc4ed5e549b1f4ed7c/etc/examples/notebooks/magic-tutorial.ipynb

Instead of rendering as plaintext when using %%sql , it would be better to be able to render it as a table.

Currently the only way to achieve this is with a 2 step process (2 cells):

1. creating a dataframe with the SQL query
2. and then render it using the %%dataframe to render it.

 

Zeppelin does this by default when using the %sql annotation. But Zeppelin is not as good as Jupyter.

 

Additionally, %%SQL magic doesn't allow to control the limit of rows to show, always defaults to 10.

Issue Links

• is cloned by: TOREE-535 Spark init configurations (jars to driver and executors)