The much proven method of agile project management has been primarily considered as a tool for software companies to drive productivity. This paper deals with the driving factors and successful implementation of agile project management in Non-IT sectors. Even though many authors have pointed out the successful implementation of Agile Project Management in IT sector and different dimensions determining the competitiveness and success rates of the project, this paper mainly focuses on the project success in five dimensions. An online survey was conducted and 322 practitioners responded from various industries regarding the success factors of agile project management. The principal component analysis reveals the correlation between the success factors and the project efficiency. Also the challenges faced and the advantages while implementing agile project management methods were also discussed.