Photovoltaic water pumping systems (PVWPS) can greatly enhance access to clean water in rural and low-income regions of sub-Saharan Africa, thereby contributing to improved health and well-being. PVWPS monitoring can significantly help for effective operation and performance, with continuous monitoring providing comprehensive data. However, there is a lack of detailed feedback on the long-term effects of continuous monitoring. This article addresses this gap by presenting a five-year case study of continuous monitoring on a PVWPS in Gogma, Burkina Faso, and by analyzing the benefits and challenges associated with such extended monitoring. We also detail the technical decisions involved in designing a robust data acquisition system (DAS) and highlight the academic contributions enabled by the five-year dataset obtained, including the development of machine learning algorithms for detecting module cleaning. Despite the clear benefits in terms of scientific research, significant challenges associated with continuous long-term monitoring have been identified, including logistical difficulties, financial constraints, and maintenance issues of DAS in remote areas. To mitigate these challenges, we suggest implementing a periodic monitoring approach, with annual or bi-annual site visits by trained technicians. This method is aimed at local practitioners, retaining the benefits of data collection while reducing costs and logistical burdens, making it suitable for practical (non-research) applications in resource-constrained environments.