Project management offices of defence acquisition projects are required to develop fair, transparent, and defensible bid evaluation plans for major procurement tenders. A key aspect of an evaluation plan is the development of an appropriate criteria weighting model. Given the uncertainties in criteria weights and performance scores, a sensitivity analysis is required to provide assurance to the overall bid evaluation plan, particularly the identification of potential extreme bids. This paper presents a stochastic Analytic Hierarchy Process method for performing high dimensional sensitivity analysis of bid evaluation plans for military systems in-service support contracts. The method integrates multi-criteria decision analysis, Monte Carlo simulation, and optimization techniques and determines a ranking probability matrix to assess the effectiveness of weighting models and to explore potential extreme bids. An example using a bid evaluation plan for a military ship in-service support contract is presented and discussed to illustrate the methodology. A set of hypothetical bid profiles, developed by military subject matter experts, is used in the analysis to wargame the bid evaluation plan. The study provides project managers with a decision support tool for refining and optimizing bid evaluation plans of military systems in-service support contracts.