The recently developed Fear of COVID-19 Scale (FCV-19S) is a seven-item uni-dimensional scale that assesses the severity of fears of COVID-19. Given the rapid increase of COVID-19 cases in Bangladesh, we aimed to translate and validate the FCV-19S in Bangla. The forward-backward translation method was used to translate the English version of the questionnaire into Bangla. The reliability and validity properties of the Bangla FCV-19S were rigorously psychometrically evaluated (utilizing both confirmatory factor analysis and Rasch analysis) in relation to socio-demographic variables, national lockdown variables, and response to the Bangla Health Patient Questionnaire. The sample comprised 8550 Bangladeshi participants. The Cronbach α value for the Bangla FCV-19S was 0.871 indicating very good internal reliability. The results of the confirmatory factor analysis showed that the uni-dimensional factor structure of the FCV-19S fitted well with the data. The FCV-19S was significantly correlated with the nine-item Bangla Patient Health Questionnaire (PHQ-90) (r = 0.406, p < 0.001). FCV-19S scores were significantly associated with higher worries concerning lockdown. Measurement invariance of the FCV-19S showed no differences with respect to age or gender. The Bangla version of FCV-19S is a valid and reliable tool with robust psychometric properties which will be useful for researchers carrying out studies among the Bangla speaking population in assessing the psychological impact of fear from COVID-19 infection during this pandemic.