In the improvement of building energy efficiency, passive design factors play a significant role in reducing building energy load with less reliance on active energy sources like HVAC and lighting fixtures without compromising occupant's comfort. The conventional methods and techniques used to analyze building energy performance are considered time-consuming and challenging with a high possibility of errors occurring. Consequently, Building Information Modeling (BIM) can be a better alternative to implementing sustainable design strategies effectively. Energy-saving concept and passive building take many subjects related to building sustainability strategy. Hence, this study investigates the impact of passive design factors: building shape, building orientation, and window-to-wall ratio within the BIM framework. For this purpose, 64 scenarios were created for a sample office building located in Jönköping city in Sweden. These scenarios varied through changing window-to-wall ratio, building orientations, and shapes. The 3D models were created using Autodesk Revit, one of the leading BIM tools. Through the gbXML file format, the model was exported to perform the energy simulations for the different scenarios using Green Building Studio. The analysis indicates that as the window-to-wall ratio increases, the energy consumption increases as well. For building shape, the less energy consumption is when the length of the building is equal to its width (square shape), since the difference between the length and width increases, the energy consumption increases as well. For the 64 scenarios, the south-facing window ' s orientation had the lowest energy use intensity compared to other orientations. This research will pave the way for further studies to increase awareness of the application of BIM regarding passive buildings and to investigate how other passive design factors could affect energy efficiency.