Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40667

Refactor File Data Source Options

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • SQL
    • None

    Description

      Currently for each file data source, all options are placed sparsely in the options class and there is no clear list of all options supported. As more and more options are added, the readability gets worse. Thus, we want to refactor those codes so that

      1. we can easily get a list of supported options for each data source
      2. enforce better practice for adding new options going forwards.

      Attachments

        Activity

          People

            xiaonany94 Xiaonan Yang
            xiaonany94 Xiaonan Yang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: