Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-386

[Umbrella] YARN API Changes

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      This is the umbrella ticket to capture any and every API cleanup that we wish to do before YARN can be deemed beta/stable. Doing this API cleanup now and ASAP will help us escape the pain of supporting bad APIs in beta/stable releases.

        Attachments

        Issue Links

        1.
        Fix inconsistent protocol naming Sub-task Closed Vinod Kumar Vavilapalli Actions
        2.
        Rationalize AllocateResponse in RM scheduler API Sub-task Closed Zhijie Shen Actions
        3.
        ApplicationMaster retry times should be set by Client Sub-task Closed Zhijie Shen Actions
        4.
        Improve documentation about what "asks" means in AMRMProtocol Sub-task Open Sandy Ryza Actions
        5.
        RM should throw different exceptions for while querying app/node/queue Sub-task Open Vinod Kumar Vavilapalli Actions
        6.
        Flatten NodeHeartbeatResponse Sub-task Closed Xuan Gong Actions
        7.
        Flatten RegisterNodeManagerResponse Sub-task Closed Xuan Gong Actions
        8.
        Clean up unused collection methods in various APIs Sub-task Closed Xuan Gong Actions
        9.
        The ID classes should be immutable Sub-task Resolved Unassigned Actions
        10.
        Move special container exit codes from YarnConfiguration to API Sub-task Closed Sandy Ryza Actions
        11.
        Define value for * in the scheduling protocol Sub-task Closed Zhijie Shen Actions
        12.
        Change startContainer NM API to accept Container as a parameter and make ContainerLaunchContext user land Sub-task Closed Xuan Gong Actions
        13.
        Remove ApplicationConstants.AM_APP_ATTEMPT_ID_ENV as it is no longer set in an AM's environment Sub-task Closed Hitesh Shah Actions
        14.
        Make it easier to access cluster topology information in an AM Sub-task Open Omkar Vinit Joshi Actions
        15.
        Make IDs read only Sub-task Resolved Siddharth Seth Actions
        16.
        Remove ContainerStatus, ContainerState from Container api interface as they will not be called by the container object Sub-task Closed Xuan Gong Actions
        17.
        AggregatedLogFormat should be marked Private / Unstable Sub-task Resolved Siddharth Seth Actions
        18.
        YarnClient.submitApplication should wait for application to be accepted by the RM Sub-task Closed Zhijie Shen Actions
        19.
        Expose resource metrics as part of YarnClusterMetrics Sub-task Open Omkar Vinit Joshi Actions
        20.
        Have YarnClient generate a directly usable ApplicationSubmissionContext Sub-task Closed Karthik Kambatla Actions
        21.
        Make all YARN API and libraries available through an api jar Sub-task Open Vinod Kumar Vavilapalli Actions
        22.
        Nodemanager should set some key information into the environment of every container that it launches. Sub-task Closed Xuan Gong Actions
        23.
        Setter of xxxxPBImpl doesn't really set the collection, but append its items to an existing collection Sub-task Resolved Zhijie Shen Actions
        24.
        Add application type to ApplicationReport Sub-task Closed Mayank Bansal Actions
        25.
        User should not be part of ContainerLaunchContext Sub-task Closed Omkar Vinit Joshi Actions
        26.
        Remove duplication of data in Container Sub-task Resolved Zhijie Shen Actions
        27.
        ApplicationReport does not provide progress value of application Sub-task Closed Hitesh Shah Actions
        28.
        RM recovery related records do not belong to the API Sub-task Closed Vinod Kumar Vavilapalli Actions
        29.
        Cleanup BuilderUtils Sub-task Open Unassigned Actions
        30.
        ContainerLaunchContext.containerTokens should simply be called tokens Sub-task Closed Vinod Kumar Vavilapalli Actions
        31.
        Add application type to submission context for map reduce Sub-task Resolved Mayank Bansal Actions
        32.
        ContainerManager.startContainer needs to only have ContainerTokenIdentifier instead of the whole Container Sub-task Closed Vinod Kumar Vavilapalli Actions
        33.
        Flatten NodeReport Sub-task Closed Sandy Ryza Actions
        34.
        masterContainer and status are in ApplicationReportProto but not in ApplicationReport Sub-task Closed Zhijie Shen Actions
        35.
        Copy BuilderUtil methods into individual records Sub-task Closed Jian He Actions
        36.
        AMRM protocol changes for sending NMToken list Sub-task Closed Omkar Vinit Joshi Actions
        37.
        Copy BuilderUtil methods into token-related records Sub-task Closed Jian He Actions
        38.
        Move RMIdentifier from Container to ContainerTokenIdentifier Sub-task Closed Vinod Kumar Vavilapalli Actions
        39.
        container-log4j.properties should not refer to mapreduce properties Sub-task Closed Zhijie Shen Actions
        40.
        AMRMClient should have a separate setProgress instead of sending progress as part of allocate Sub-task Open Vinod Kumar Vavilapalli Actions
        41.
        Rename ResourceRequest (get,set)HostName to (get,set)ResourceName Sub-task Closed Arun Murthy Actions
        42.
        Rename AllocateResponse.reboot to AllocateResponse.resync Sub-task Closed Bikas Saha Actions
        43.
        Create Command enum in AllocateResponse Sub-task Closed Bikas Saha Actions
        44.
        Move PreemptionContainer/PremptionContract/PreemptionMessage/StrictPreemptionContract/PreemptionResourceRequest to api.records Sub-task Closed Jian He Actions
        45.
        Add individual factory method for api protocol records Sub-task Closed Jian He Actions
        46.
        Move BuilderUtils from yarn-common to yarn-server-common Sub-task Closed Jian He Actions
        47.
        Make ApplicationAttemptID, ContainerID, NodeID immutable Sub-task Closed Jian He Actions
        48.
        Some Exceptions no longer need to be wrapped by YarnException and can be directly thrown out after YARN-142 Sub-task Closed Jian He Actions
        49.
        Move ProtoBase from api.records to api.records.impl.pb Sub-task Closed Jian He Actions
        50.
        Move YarnRuntimeException from package api.yarn to api.yarn.exceptions Sub-task Closed Jian He Actions
        51.
        Investigate adding a more generic error field to AMResponse Sub-task Open Unassigned Actions
        52.
        ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter Sub-task Closed Xuan Gong Actions
        53.
        Remove unreferenced objects from proto Sub-task Closed Jian He Actions
        54.
        Expose LOGDIR that containers should use for logging Sub-task Closed Jian He Actions
        55.
        Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API Sub-task Closed Sandy Ryza Actions
        56.
        Move NodeHealthStatus from yarn.api.record to yarn.server.api.record Sub-task Closed Jian He Actions
        57.
        AMRMClient support for resource blacklisting Sub-task Closed Junping Du Actions
        58.
        Augment AM - RM client module to be able to request containers only at specific locations Sub-task Closed Sandy Ryza Actions
        59.
        Remove resource min from Yarn client API Sub-task Closed Alejandro Abdelnur Actions
        60.
        Fix yarn-api javadoc annotations Sub-task Closed Jian He Actions
        61.
        Move ContainerExitStatus from yarn.api to yarn.api.records Sub-task Closed Jian He Actions
        62.
        YARN application classpath should add $PWD/* in addition to $PWD Sub-task Open Jian He Actions
        63.
        Rename FinishApplicationMasterRequest.setFinishApplicationStatus to setFinalApplicationStatus to be consistent with getter Sub-task Closed Jian He Actions
        64.
        Move RMAdmin from yarn.client to yarn.client.cli and rename as RMAdminCLI Sub-task Closed Jian He Actions
        65.
        Add static factory to yarn client lib interface and change it to abstract class Sub-task Closed Jian He Actions
        66.
        Fix yarn-common javadoc annotations Sub-task Closed Vinod Kumar Vavilapalli Actions
        67.
        Need to make Resource arithmetic methods accessible Sub-task Closed Jian He Actions
        68.
        Remove resource min from GetNewApplicationResponse Sub-task Closed Jian He Actions
        69.
        Update Resource javadoc to clarify units for memory Sub-task Resolved Unassigned Actions
        70.
        Review/fix annotations for yarn-client module and clearly differentiate *Async apis Sub-task Closed Zhijie Shen Actions
        71.
        Move Clock/SystemClock to util package Sub-task Closed Zhijie Shen Actions
        72.
        The name 'ApplicationTokenIdentifier' is misleading Sub-task Resolved Vinod Kumar Vavilapalli Actions
        73.
        Rename ApplicationToken to AMRMToken Sub-task Closed Omkar Vinit Joshi Actions
        74.
        Move ProtoUtils to yarn.api.records.pb.impl Sub-task Closed Jian He Actions
        75.
        ClusterInfo.java doesn't seem to belong to org.apache.hadoop.yarn Sub-task Closed Zhijie Shen Actions
        76.
        Annotate and document AuxService APIs Sub-task Closed Vinod Kumar Vavilapalli Actions
        77.
        Move pb Impl from yarn-api to yarn-common Sub-task Closed Jian He Actions
        78.
        Rename getClusterAvailableResources to getAvailableResources in AMRMClients Sub-task Closed Jian He Actions
        79.
        Move Resources and the calculators to a new package util.resource in yarn-common Sub-task Resolved Jian He Actions
        80.
        YARNClient.getApplicationReport(unknownAppId) returns a null report Sub-task Closed Xuan Gong Actions
        81.
        Consider adding clone methods to protocol objects Sub-task Open Junping Du Actions
        82.
        yarn.application.classpath requires client to know service internals Sub-task Open Sandy Ryza Actions
        83.
        ApplicationReport can return tokens only when users asks for it explicitly Sub-task Open Unassigned Actions
        84.
        Deprecate/ mark private few methods from YarnConfiguration Sub-task Resolved Unassigned Actions
        85.
        ApplicationContants should be a proto definition instead of being a java class Sub-task Open Unassigned Actions
        86.
        FinishApplicationMasterRequest should also have a final IPC/RPC address. Sub-task Open Junping Du Actions
        87.
        NM silently ignores non-existent service in StartContainerRequest Sub-task Closed Xuan Gong Actions
        88.
        AMRMClientAsync missing blacklist addition and removal functionality Sub-task Closed Bartosz Ɓugowski Actions

          Activity

            People

            • Assignee:
              vinodkv Vinod Kumar Vavilapalli
              Reporter:
              vinodkv Vinod Kumar Vavilapalli

              Dates

              • Created:
                Updated:

                Issue deployment