Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10359

Enumerate Spark's dependencies in a file and diff against it for new pull requests

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.3, 1.6.1, 2.0.0
    • Build, Project Infra
    • None

    Description

      Sometimes when we have dependency changes it can be pretty unclear what transitive set of things are changing. If we enumerate all of the dependencies and put them in a source file in the repo, we can make it so that it is very explicit what is changing.

      Attachments

        Activity

          apachespark Apache Spark added a comment -

          User 'pwendell' has created a pull request for this issue:
          https://github.com/apache/spark/pull/8531

          apachespark Apache Spark added a comment - User 'pwendell' has created a pull request for this issue: https://github.com/apache/spark/pull/8531
          srowen Sean R. Owen added a comment -

          Is SPARK-4123 a dupe of this or vice versa then?

          srowen Sean R. Owen added a comment - Is SPARK-4123 a dupe of this or vice versa then?

          The approach in SPARK-4123 was a bit different, but there is some overlap. We ended up reverting that patch because it wasn't working consistently. I'll close that one as a dup of this one.

          pwendell Patrick Wendell added a comment - The approach in SPARK-4123 was a bit different, but there is some overlap. We ended up reverting that patch because it wasn't working consistently. I'll close that one as a dup of this one.
          apachespark Apache Spark added a comment -

          User 'JoshRosen' has created a pull request for this issue:
          https://github.com/apache/spark/pull/10461

          apachespark Apache Spark added a comment - User 'JoshRosen' has created a pull request for this issue: https://github.com/apache/spark/pull/10461
          joshrosen Josh Rosen added a comment -

          Issue resolved by pull request 10461
          https://github.com/apache/spark/pull/10461

          joshrosen Josh Rosen added a comment - Issue resolved by pull request 10461 https://github.com/apache/spark/pull/10461
          apachespark Apache Spark added a comment -

          User 'JoshRosen' has created a pull request for this issue:
          https://github.com/apache/spark/pull/10543

          apachespark Apache Spark added a comment - User 'JoshRosen' has created a pull request for this issue: https://github.com/apache/spark/pull/10543
          apachespark Apache Spark added a comment -

          User 'JoshRosen' has created a pull request for this issue:
          https://github.com/apache/spark/pull/10558

          apachespark Apache Spark added a comment - User 'JoshRosen' has created a pull request for this issue: https://github.com/apache/spark/pull/10558
          apachespark Apache Spark added a comment -

          User 'JoshRosen' has created a pull request for this issue:
          https://github.com/apache/spark/pull/10679

          apachespark Apache Spark added a comment - User 'JoshRosen' has created a pull request for this issue: https://github.com/apache/spark/pull/10679
          apachespark Apache Spark added a comment -

          User 'JoshRosen' has created a pull request for this issue:
          https://github.com/apache/spark/pull/10680

          apachespark Apache Spark added a comment - User 'JoshRosen' has created a pull request for this issue: https://github.com/apache/spark/pull/10680

          People

            joshrosen Josh Rosen
            pwendell Patrick Wendell
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: