Research consultation clinic: impetus towards facilitating primary care research
© Tan et al.; licensee BioMed Central Ltd. 2013
Received: 7 June 2013
Accepted: 13 September 2013
Published: 16 September 2013
In Singapore, SingHealth Polyclinics (SHP) is an accredited Family Medicine (FM) training centre which managed 1.8 million primary care patient-visits in 2012. To promote research in the institution, research consultation clinics (RCC) are being introduced in 2010 to enable free face-to-face consultation between experienced and novice researchers on specific research topics. Each RCC session allows about an hour or more for the SHP staff, medical undergraduates and general practitioners to seek advice and clarification on key research areas, ranging from research question refinement, study design and execution, data analysis, result presentation to publication. The consultants comprise of two FM researchers with postgraduate research qualification.
This article aims to review the implementation of RCC from 2010 to 2012 and its impact on research activities and outcome indicators in the same period of time.
The study comprised of two segments. Part I was a three-year retrospective review of the RCC administrative record. The total number of RCC sessions, hours utilised, participants’ profiles, the number of research studies initiated by them and their research presentations at local and overseas scientific meetings/conferences were computed. Part 2 was an anonymous web-based questionnaire survey fielded to RCC participants to collect their feedback on the RCC service and their self-reported initiation and completion of research study after the RCC consultation.
The RCC sessions increased from 17 to 40 sessions, resulting in increment of 2 to 14 research presentations and from 2 to 6 initiations of new research studies per annum from 2010–2012. The response rate to the questionnaire survey was 70.3%, with the majority of multi-disciplinary respondents rated the RCC service to be accessible, adequate and were satisfied with its quality. Study design, data management and study execution were ranked as important areas of research for consultation. 79% of them had started a research project and 36% had completed their studies.
The RCC is a feasible model to catalyse multi-disciplinary research in primary care institutions. Further study is needed to evaluate its relevance when research advances and novice researchers become experienced investigators to take on more complex projects.
KeywordsResearch Consultation Primary care
A strong primary healthcare system is vital to improve the health of the general population and reduce the healthcare burden to the nation [1, 2]. Research in primary care aims largely to seek better understanding of disease management in relation to the individuals, families and the community, and to evaluate the effectiveness and efficiency of healthcare practices and health policies . Beyond general practice and family medicine, primary care research is multi-disciplinary, covering community nursing and pharmacy, sociology, health service and policy research. As primary care supports the base of the population pyramid and amidst a rapidly expanding global population, there is an urgency to scale up primary care research to seek medical evidence to prevent, cure, and care for diseases; to translate these evidences into regular clinical practice and to formulate policies to ensure universal equity of care .
However, primary care research faces challenges, even in resource-rich countries, due to limitations of research capacity in general practice, inadequate research infrastructure in primary care and poor provision of support to individual general practitioners to conduct research. Saad H. Al-Abdullateef in a survey of general practitioners in selected primary care centres in Saudi Arabia showed that while a majority expressed interest (66%) and planned to carry out research (74.2%), they cited insufficient time (83.5%) and lack of support (58.8%) as key barriers to research .
Practice-based research networks (PBRNs) are groups of practices networked together to undertake research relevant to general practice and the local community's needs [6, 7]. These PBRNs, often involving collaborations between practitioners and academicians, can expand the capacity and bandwidth of primary care physicians . Nonetheless, these PBRNs are largely medical, whist nurses and other researchers tend to form their respective research networks. Furthermore, a survey of a New York based PBRNs revealed that only 25% of the physicians had formal research training and 21% of them had clinical research certification . Lack of time or competing demands for time was the top ranked barrier (92%) in the survey, and 80% of the clinicians reported that their lack of appropriate training was a barrier . Thus, participation in PBRNs may not adequately address the specific research needs nor provide training for the individual primary care researchers; neither does it add impetus towards multi-disciplinary research in primary care.
Nevertheless, there are ample research related training opportunities that are available from the local academic institutions to equip primary care professionals with basic research skills. Basic research training is incorporated in medical undergraduate education curriculum, and in the respective master degree programmes for community nurses and pharmacists who take on advanced professional training.
Aside from training, mentorship appears to be pivotal in moulding primary care practitioners into researchers. Curtis P et al. reported that amongst Family Medicine (FM) graduates who received the American National Research Service Awards, they were less successful in terms of research and publication output compared to fellow recipients such as internists and paediatricians . The authors attributed the differences to a lack of protected time and sustained research mentorship for the family physicians. Likewise, in Israel, FM residents trained under pro-research mentors were likely to be more intensely involved in research when they became family physicians .
A strong and increased level of commitment from primary care organisations is needed to provide support and resources and to reduce barriers for family physicians to carry out research . Hannaford P et al. showed that a modest investment of resources and support will create substantial increases in both the quality and quantity of primary care research . They recommended that this investment should be targeted at both existing primary care professionals working in service settings in primary care and those in the academic departments in the universities . Various funding models for primary care research have since been developed and implemented in various countries, centred largely on channelling government funding via FM departments in universities in Australia & the Netherlands, or via the Royal College of General Practitioners in Britain [14–16]. However how effective and efficient are these funding models in promoting primary care research and enhance research-related training for the general practitioners are seldom measured, and its translation into actual research endeavours are rarely evaluated. A new model to expedite primary care research in terms of effective individual coaching and efficient application is urgently needed to empower the primary care practitioners.
Primary care research faces similar challenges in Singapore, where infrastructure constraints and healthcare resources were hithertho barriers to its development . However in recent years, despite the lack of dedicated research funding for primary care researchers from the local official research agencies, rapid development of academic medicine in the local public healthcare institutions resulted in unprecedented support for primary care research from primary healthcare organisations, such as SingHealth Polyclinics (SHP). The latter comprises a cluster of nine public primary care clinics or polyclinics in Singapore, which is also a recognised FM training centre accredited by the American College of General Medical Education. Whilst governance, policy and finance are centrally administered in SHP, the polyclinics operate at various sites to serve the local communities in the southern and eastern parts of Singapore using a common and integrated electronic medical records system. Thus in terms of primary care research, the institution can be regarded as a de-facto practice-based multi-disciplinary research network.
Novice researchers from SHP can seek seed funding from SHP to support their approved research projects whilst established researchers are encouraged to vie for competitive research grants from national research agencies. Whilst financial support to kick-start research for these researchers is no longer a barrier, approval for seed funding is based on the evaluation of research proposals’ scientific merits and logistic considerations. Hence novice researchers find it propitious to consult experienced researchers for guidance in order to optimise their success rates in their seed funding or other grant applications.
With the endorsement from senior management in SHP, research consultation clinics (RCC) are established in May 2010 to support budding FM researchers in the institution. Dedicated resources are channelled centrally from institution annual operating budget to set up the RCC service. This caters to the opportunistic cost for the consultants, as well as the participants to meet at the RCC for free face-to-face consultations during clinic operating hours. It also provides for the seed funding for researchers to support the execution of their project.
Each RCC session allows at least an hour for any individual or group of multi-disciplinary SHP staff to seek advice and clarification on any issues pertaining to their research endeavours. During the consultation sessions, the topics covered include the various domains in research, ranging from exploring research idea, definition of research question, research method, project design, application for ethics committee review, logistic planning, data analysis and interpretation to results presentation and publication. The participants can arrange for multiple consultations to clarify queries for their same study or repeat consultation for another study.
The RCC sessions are taken up by SHP multi-disciplinary staff, including doctors, nurses and pharmacists who plan to commence research as part of their professional development or are pursuing advanced training programmes which incorporate research as part of the curriculum. The service is also open to external primary care researchers, including private general practitioners, and medical students from the two local medical colleges, under the over-arching objective of enhancing primary care research development and foster research collaborations between different primary healthcare providers in Singapore. This necessitates the increase of consultants from one to two to manage the expanded RCC capacity. The consultants are FM researchers within the institution with post-graduate qualifications in research.
Periodic evaluation of the service provided by RCC from the participants is vital to ensure that this model of research support remains relevant and its service caters adequately to their needs. This study aims to determine the level of satisfaction amongst the RCC participants in terms of their perception of the accessibility of the service, adequacy of the duration of the consultation, effectiveness of the consultancy, the key research areas in which they seek consultation, and the outcomes of the RCC consultation.
The evaluation of the RCC service comprises of two segments. The first part was a retrospective review of the RCC records from 2010–2012 to determine the short-term accomplishments of past participants in terms of their research study initiation and subsequent oral or poster presentation at academic meetings and/or scientific conferences. “New study” is defined as study initiated within the respective calendar year with reference to its date of approval from the institutional review board. The research presentations refer to investigators’ presentations of their research findings at local or overseas scientific meetings or conferences which are approved by SHP. Both outcomes were traced from the respective databases in the SHP Department of Research.
The second segment was a questionnaire survey of the same cohort of participants. Each participant was invited to undertake a web-based questionnaire survey regardless of the frequency of RCC participation. The sampling frame comprised of participants who had utilised the RCC service at least once and who had provided their email contact. The records show a list of 75 RCC participants between January 2010 and December 2012, of which email addresses were provided by 64 of them.
demographic profile such as age, gender, education status, staff category
views on accessibility of the service,
quality of the consultancy,
ranking of key research domains for which they sought consultation
outcome measures of RCC in terms of initiation and completion of their respective research projects
The questionnaire survey was anonymous to ensure truthful responses from the participants. The investigators notified the participants of the survey via their email addresses. Second and third round of notices were delivered to the participants’ email addresses to serve as reminders to participate in the survey on the second and third week respectively after the commencement of the first survey.
The survey was designed using the web-based Qualtrics platform to field the questionnaire. The participants would read the study’s objectives and other research-related information according to the Participant Information Sheet prior to answering the questionnaire. Due to anonymity of the questionnaire and the minimal risk nature of the study, approval was obtained from the Institutional Review Board (CIRB reference no: 2013/253/E ) to waive the written consent of the participant. The data from the completed questionnaire were imported into MS Excel for computation and analysis.
For the questionnaire survey, 64 email addresses from a list of 75 participants were found to be unique and currently valid. 45 of them responded to the survey, constituting a response rate of 70.3% (45/64). 39 of them completed the entire questionnaire, which formed the denominator for the computation of the results.
Demographic profile of RCC participants
Retrospective review of department record
Number (n) Total = 64
Number (n) Total = 45
Domain of work
Non-SHP Staff (e.g. GP, Medical students)
Age group (Year)
61 and above
Medical (Medical students and GP inclusive)
Nursing and pharmacy
Accessibility, quality and perceived value of consultancy at RCC
Accessibility to RCC
Views of participants n = 39
Total disagree/disagree n/(%)
Totally agree/agree n/(%)
I can easily book a RCC appointment.
I feel that the RCC, currently held on two afternoons per week are adequate.
The venue at a centralised location in HQ is convenient.
The one-hour time slot per RCC session is adequate.
Quality and perceived value of consultancy at RCC
Views of participants n = 39
Totally agree n/(%)
The consultant at RCC is qualified to provide the consultation.
The consultation provides the information that I need for my research project.
The consultation helps in my research.
I appreciate that RCC service is currently free of charge.
Some investigators have already started their study and sought consultation at RCC in the midst of their study execution. This accounted for the difference between those who indicated that they had initiated their research (79%) and those who have completed or in the process of carrying out their studies (36% + 49% or 85%).
The study shows that the establishment of RCC can be a catalyst to facilitate research in primary healthcare institution. It is a system approach to empower novice researchers to embark on research. The RCC serves as a platform for researcher-centric coaching, which caters to their individual or team’s specific needs when they plan or are in the midst of executing research. Most of the participants have undertaken basic research training at local academic institutions. However these generic structured training programs may not provide answers to specific questions or solutions to problems encountered by the individual or team members during the planning or execution stages. The RCC bridges this gap, with the consultants functioning as mentors to guide these researchers. Once these researchers gain hands-on experience and confidence after these beginners’ trials or studies, it sets the stage for them to pursue advanced research training program and to take on more complex studies.
The key elements for a successful set-up include support from senior management to provide the appropriate resources, ensuring that the service is accessible and convenient. Adequate time allocation and quality of the consultancy are essential elements for successful service delivery to the participants. Based on their rankings, most participants value the consultation in critical areas of research, such as study design, execution and data management. These components will appeal to novice researchers who are commencing their early phases of research planning and execution. Nonetheless, established researchers can also use the RCC service, as peer reviews by consultants serve to polish up their presentations and publications.
This study is the first in the healthcare institution and provides a timely evaluation of the needs of the staff members, who are planning or have already embarked on research for the past three years. However, about one in five participants have yet to initiate their study after the RCC consultation. Further research will be required to understand their other unmet needs and identify other barriers that could have hindered their initiation. There is also a lag time between research consultation and the initiation of new studies due to logistic reasons such as application for ethics approval and lack of research funding.
The evaluation of the research support service needs to be implemented on a regular basis to stay relevant to the evolving research developments in SHP. As novice researchers become more experienced and take on more complex research studies, the service will need to expand. To enhance the RCC service, additional expertise is required to augment the small pool of family physicians cum consultants, including biostatistician, epidemiologist and bioinformatics professional. A biostatistical consultation clinic, facilitated by a biostatistician, has been set up in SHP to complement the RCC in September 2012. Further study will be carried out to determine its effectiveness in providing biostatistical support to the researchers. Gathering qualitative feedback from the consultants on the RCC service will close the evaluation loop in future study.
One limitation of the survey is the failure of the investigators to reach out to all the RCC participants. These include individuals who had left the organisation or medical students who had already graduated, resulting in change of their email addresses. Administrative support will need to be enhanced to ensure that the participants’ contacts are periodically updated, which may ameliorate the response rate of subsequent surveys. In addition, absolute and opportunistic cost of providing the resources in operating the RCC, including time and manpower, will be computed in future surveys, as the basis of cost effectiveness analysis.
The establishment of research consultation clinic in a primary healthcare institution helps to support and facilitate research amongst its staff. Accessibility, convenience, adequacy and quality of the consultancy are key elements for its successful implementation. It can be measured by process outcomes such as the number of new research projects initiated and publications in journals.
KPT is the manager of department of research, SingHealth Polyclinics. TYT is the executive of department of research, SingHealth Polyclinics. TNC is the director of department of research, SingHealth Polyclinics. He is also a family physician (senior consultant) at SingHealth Polyclinics (Pasir Ris), an adjunct assistant professor of Duke-NUS Graduate Medical School.
We would like to thank Qualtrics which provided us free online platform to carry out data collection and analysis.
- Macinko J, Starfield B, Shi L: The contribution of primary care systems to health outcomes within Organization for Economic Cooperation and Development (OECD) countries, 1970–1998. Health Serv Res 2003,38(3):831–865. 10.1111/1475-6773.00149PubMed CentralPubMedView ArticleGoogle Scholar
- Starfield B, Shi L, Macinko J: Contribution of primary care to health systems and health. Milbank Q 2005, 83: 457–502. 7 10.1111/j.1468-0009.2005.00409.xPubMed CentralPubMedView ArticleGoogle Scholar
- Green LA: The research domain of family medicine. Ann Fam Med 2004,2(Suppl 2):S23-S29.PubMed CentralPubMedView ArticleGoogle Scholar
- De Maeseneer JM, van Driel ML, Green LA, van Weel C: The need for research in primary care. Lancet 2003,362(9392):1314–1319. 10.1016/S0140-6736(03)14576-XPubMedView ArticleGoogle Scholar
- Al-Abdullateef SH: A survey of the attitude and practice of research among doctors in Riyadh Military Hospital primary care centers, Saudi Arabia. J Fam Community Med 2012,19(1):38–42. 10.4103/2230-8229.94012View ArticleGoogle Scholar
- Jones C: Laboratories of primary care: Practice-based research networks in Canada. Canadian Fam Physician 2006,2006(52):1045–1046.Google Scholar
- Dwan KM, Magin PJ: The desire for research in general practice. Aust Fam Physician 2008,37(10):871–873.PubMedGoogle Scholar
- Pearce K, et al.: How and Why to Study the Practice Content of a Practice-Based Research Network. Ann Fam Med 2004,2(5):425–428. 10.1370/afm.133PubMed CentralPubMedView ArticleGoogle Scholar
- Bakken S, Lantigua RA, Busacca LV, Bigger JT: Barriers, enablers, and incentives for research participation: a report from the Ambulatory Care Research Network (ACRN). J Am Board Fam Med 2009,22(4):436–445. 10.3122/jabfm.2009.04.090017PubMed CentralPubMedView ArticleGoogle Scholar
- Curtis P, Dickinson P, Steiner J, Lanphear B, Vu K: Building capacity for research in family medicine: is the blueprint faulty? Fam Med 2003,35(2):124–130.PubMedGoogle Scholar
- Giveon S, Kahan E, Kitai E: Factors associated with family physicians’ involvement in research in Israel. Acad Med 1997,72(5):388–390. 10.1097/00001888-199705000-00020PubMedView ArticleGoogle Scholar
- Beasley JW, Starfield B, van Weel C, Rosser WW, Haq CL: Global health and primary care research. J Am Board Fam Med 2007,20(6):518–526. 10.3122/jabfm.2007.06.070172PubMedView ArticleGoogle Scholar
- Hannaford P, Hunt J, Sullivan F, Wyke S: Shaping the future: a primary care research and development strategy for Scotland. Health Bull (Edinb) 1999,57(5):295–299.Google Scholar
- Del Mar C, Askew D: Building family/general practice research capacity. Ann Fam Med 2004,2(Suppl 2):S35-S40.PubMed CentralPubMedView ArticleGoogle Scholar
- van Weel C, Rosser WW: Improving health care globally. A critical review of the necessity of family medicine research and recommendations to build research capacity. Ann Fam Med 2004,2(Suppl 2):S5-S16.PubMed CentralPubMedView ArticleGoogle Scholar
- Campbell SM, Roland MO, Bentley E, Dowell J, Hassal K, Pooley JE, et al.: Research capacity in UK primary care. Br J Gen Pract 1999, 49: 967–970.PubMed CentralPubMedGoogle Scholar
- Tan NC, Goh LG: Primary Care Research – A Blueprint for Action for Singapore. APJPH 2001,43(1):49–53.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.