Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-372

Create JSON arrow file format for integration tests

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.2.0
    • Java
    • None

    Description

      {
        "schema" : ...,
        "batches" : [{
          "count" : 10,
          "columns" : [
            {
              "name": "{col_name_int}",
              "count" : 10,
              "VALIDITY" : [1,1,1,1,1,1,1,1,1,1],
              "DATA" : [0,1,2,3,4,5,6,7,8,9]
            },
            { 
              "name": "{col_name_list}",
              "count" : 10,
              "VALIDITY" : [1,1,1,1,1,1,1,1,1,1],
              "OFFSET" : [0,0,1,3,3,4,6,6,7,9],
              "children" : {
                {
                  "name": "child_name",
                  "count" : 9,
                  "VALIDITY" : [1,1,1,1,1,1,1,1,1,1],
                  "OFFSET" : [0,3,6,9,12,15,18,21,24],
                  "DATA" : ["abc","abc","abc","abc","abc","abc","abc","abc","abc"]
                }
              }
            },
            {
              "name": "{col_name_map}",
              "count" : 10,
              "VALIDITY" : [1,1,1,1,1,1,1,1,1,1],
              "children" : {
                {
                  "name": "{col_name_timestamp}",
                  "count" : 10,
                  "VALIDITY" : [1,1,1,1,1,1,1,1,1,1],
                  "DATA" : [0,1,2,3,4,5,6,7,8,9]
                }
              }
            }
          }, ... ]
      }
      

      Attachments

        Issue Links

          Activity

            People

              julienledem Julien Le Dem
              julienledem Julien Le Dem
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: