Theoretically, open source solutions are a good match with the resource scarce organization such as a young academic journal to make the publication process and the knowledge shared explicit to the participants in the system. This paper uses a case study approach to investigate how the decision to have such a system depends on a myriad of factors, and tracks how the editorial team decided to adopt an open source journal management system for their knowledge management issues. The study argues that these components should not be taken in isolation by showing how the previous decisions can become a hindrance as these components change over time. The results show that some factors, though initially thought to be unimportant, can become major forces as the journal matures, and a more holistic approach could help to side-step the problems faced.