Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-613

Livy can't handle the java.sql.Date type correctly

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.7.0
    • Component/s: REPL
    • Labels:
      None

      Description

      When Spark table has java.sql.Date type column, Livy can't handle the java.sql.Date type correctly. e.g

      create table test(
          name string,
          birthday date
      );
      
      insert into test values ('Livy', '2019-07-24')
      
      curl -H "Content-Type:application/json" -X POST -d '{"code":"select * from test", "kind":"sql"}' 192.168.1.6:8998/sessions/48/statements
      {"id":1,"code":"select * from test","state":"waiting","output":null,"progress":0.0}
      
      curl 192.168.1.6:8998/sessions/48/statements/1
      {"id":1,"code":"select * from test","state":"available","output":{"status":"ok","execution_count":1,"data":{"application/json":{"schema":{"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"birthday","type":"date","nullable":true,"metadata":{}}]},"data":[["Livy",{}]]}}},"progress":1.0}

      as you can see, the output of `select * from test` is ["Livy",{}], birthday column's value isn't handle  correctly.

      The reason is that json4j can't handle java.sql.Date, so we should define the CustomSerializer for java.sql.Date.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                397090770 wyp
                Reporter:
                397090770 wyp
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m