Sugar industry plays a vital role in the economy of Bangladesh by way of farming and creation of employment. But unfortunately, every year a good number of accidents occur and this sector pays a high price for accidents or injuries in terms of human sufferings and economic losses. On this background this research aims at finding out the significant factors of accident as per the view of the workers. In data collection, questionnaire survey was carried out on the basis of the sample size. In the analysis section, twenty-five factors under four headings were identified through field visits, journal papers and internet search. The analysis of the collected data was started with the reliability analysis of the four major factors such as ‘personal factors’, ‘work factors’, ‘accident mechanism’, ‘unsafe act’. Z-test and Relative Importance Index (RII) method was used to analyze it.  The findingsrevealed the significant sub-factors of accidents. The significant sub-factors were workers negligence for safety practices, lack of training, lack of supervision, inadequate maintenance, lack of safety measure, fatigue due to pressure or time limitation, workers avoidance reporting unsafe act, coordination gap, confined work area, lack of judgement, lack of attention to ergonomic/ human factors, ineffective warnings,  inadequate protection and barriers, objects dropped, rotating machinery, inadequate handling of materials and inadequate identification of risky items. Finally, some suggestions have been recommended to prevent accidents in the sugar mills. Safety should be the priority for all industrial activities. This research work will help the stakeholders to make and revise the safety issue in the sugar industries.