Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21265

Cache method could specified name

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.0.2, 2.1.1
    • None
    • SQL
    • None

    Description

      Currently when I cache dataset in my cluster I found the RDD Name is the RDD Schema in Storage Tab . When the sturcture is very complex , it's hard to read . So I wish could add a parameter to specified the RDD's name , the RDD's default name is schema .

      Project [ftime#141, id#142L, ei#143, ui#144, kv#145, sts#146L, jsontostruct(StructField(filter,StringType,true), StructField(is_auto,StringType,true), StructField(omgid,StringType,true), StructField(devid,StringType,true), StructField(guid,StringType,true), StructField(ztid,StringType,true), StructField(page_step,StringType,true), StructField(itemValue,StringType,true), StructField(reportParams,StringType,true), StructField(build_type,StringType,true), StructField(ref_page_id,StringType,true), StructField(itemName,StringType,true), StructField(imei,StringType,true), StructField(lid,StringType,true), StructField(app_start_time,StringType,true), StructField(omgbizid,StringType,true), StructField(imsi,StringType,true), StructField(vid,StringType,true), StructField(page_id,StringType,true), StructField(pid,StringType,true), StructField(notification_enable,StringType,true), StructField(call_type,StringType,true), StructField(streamid,StringType,true), StructField(flavor,StringType,true), ... 12 more fields) AS ...
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              darion darion yaphet
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: