Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-15790

[C++] field's metadata is not written to Parquet file

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Duplicate
    • None
    • None
    • None
    • None
    • Ubuntu

    Description

      I used this code to test the metadata write into file and read back behavior of parquet  file:

      https://gist.github.com/dantrim/33f9f14d0b2d3ec45c022aa05f7a45ee

       

      The generated file does not have metadata when I read the file in using code below and print it out: 
       

      std::shared_ptr<arrow::io::ReadableFile> infile;
      PARQUET_ASSIGN_OR_THROW(infile,
      arrow::io::ReadableFile::Open("./test.parquet", arrow::default_memory_pool()));

      std::unique_ptr<parquet::arrow::FileReader> reader;
      PARQUET_THROW_NOT_OK(
      parquet::arrow::OpenFile(infile, arrow::default_memory_pool(), &reader));
      std::shared_ptr<arrow::Table> table;
      PARQUET_THROW_NOT_OK(reader->ReadTable(&table));
      EXPECT_EQ(frameCount, table->num_rows());
      std::cout<<"==="<<table->schema()->ToString(true) <<std::endl; /// no meta shown

      Here is the version info:
      libparquet-dev/focal,now 7.0.0-1 amd64 [installed]
      libparquet-glib-dev/focal,now 7.0.0-1 amd64 [installed]
      libparquet-glib700/focal,now 7.0.0-1 amd64 [installed,automatic]
      libparquet700/focal,now 7.0.0-1 amd64 [installed,automatic]

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              sclaker Sifang Li
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: