13.Qualitative09.Delphi - sporedata/researchdesigneR GitHub Wiki

1. A Delphi process is a well-established method for achieving consensus from multiple stakeholders. It consists of sequential questionnaires to systematically solicit and collect specific information on a particular topic. The first round typically begins with an open-ended questionnaire. Several variations of the Delphi method have been described, where researchers have modified the approach to suit their needs [1]. The most popular are listed below.

   a. Modified Delphi: A similar method to the classic Delphi process. The ‘modification’ usually involves experts meeting (e.g., interviews, focus group) to discuss/rate the results or the use of pre-generated items in round one, derived from the literature. See Joint international consensus statement for ending stigma of obesity.

   b. Policy Delphi: Uses experts' opinions to generate potential resolutions to policy issues or generate ideas on future policy directions. See A policy Delphi study to validate the key implications of data sharing (KIDS) framework for pediatric genomics in Canada.

   c. Real-time Delphi: No ‘rounds’ are used, with calculation and provision of responses fed back to participants in real-time. Participants do not judge at discrete intervals (i.e., rounds) but can change their opinion as often as they like within the timeframe set. See Real-Time Delphi in practice — A comparative analysis of existing software-based tools.

   d. Internet-based Delphi: Also known as "e-Delphi," or "web-based Delphi," follows the same process as the classic Delphi but is conducted using an online platform. See Expert consensus on the important chronic non-specific neck pain motor control and segmental exercise and dosage variables: An international e-Delphi study.

2. To concept/framework development - see A national consensus management pathway for paediatric inflammatory multisystem syndrome temporally associated with COVID-19 (PIMS-TS): results of a national Delphi process

3. To forecasting and issue identification/prioritization - see Scenarios for population health inequalities in 2030 in Europe: the EURO-HEALTHY project experience.

1. A panel that will participate in the DELPHI exercise, including experts with knowledge on specific relevant sub-themes, healthcare providers, target population (e.g., cancer patients, veterans, etc), and one family member of each patient in the panel.

• It is necessary to select members for a Steering Committee from the team of investigators. The Steering Committee will summarize responses from the iterative DELPHI consensus rounds, prepare group feedback to panel respondents, and identify any concerns moving forward to reaching consensus. Although the DELPHI consensus exercise intends to allow panel members to judge and filter the provided information, the Steering Committee may need to make some decisions to reduce the number of protocols if the panel cannot achieve a consensus on many criteria. This approach is necessary to prevent the risk of overburden to DELPHI panelists for subsequent rounds [2]. Then, any reduction in selected protocols is communicated to panel members, providing them with an opportunity to respond to the feedback. This process ensures that any potential for bias is identified and rectified in subsequent rounds [2].

• Usually, Delphi undergoes four distinct phases. (1) The first phase is characterized by exploring the subject under discussion, wherein each individual contributes additional information he feels is pertinent to the issue. The panel evaluates and revises the domains from the literature review, ultimately formulating core components. (2) The second phase involves reaching an understanding of how the group views the issue (i.e., where the members agree or disagree and what they mean by relative terms such as importance, desirability, or feasibility). To do so, a questionnaire is constructed to present the first draft of the protocol. The panel members then provide suggestions, complement, and rephrase the protocol recommendations. (3) If there is significant disagreement, then that disagreement is explored in the third phase to reveal the underlying reasons for the differences and possibly evaluate them. In this phase, panel members also provide suggestions for complementing and rephrasing the text. (4) The final evaluation phase, occurs when all previously gathered information has been initially analyzed and the evaluations have been fed back for consideration. Further, there is a possibility to provide closing remarks on the proposed wording. The last step presents the final draft of the enhanced protocol.

1. Books

   • The Delphi Method - Techniques and Applications [3].

2. Articles

   • The Delphi method as a research tool: an example, design considerations and applications [4].

Delphi Template

---

[1] Varndell W, Fry M, Lutze M, Elliott D. [Use of the Delphi method to generate guidance in emergency nursing practice: A systematic review] (https://pubmed.ncbi.nlm.nih.gov/32238322/). International Emergency Nursing. 2021.

[2] Hasson F, Keeney S, McKenna H. [Research guidelines for the Delphu survey technique]. (https://pubmed.ncbi.nlm.nih.gov/11095242/). Journal of Advanced Nursing. 2000, 1008-1015.

[3] Linstone HA, Turoff M. [The Delphi Method - Techniques and Applications] (https://web.njit.edu/~turoff/pubs/delphibook/delphibook.pdf). Addison-Wesley. 2002.

[4] Okoli C, Pawlowski SD. [The Delphi method as a research tool: an example, design considerations and applications] (https://www.sciencedirect.com/science/article/pii/S0378720603001794). Information & Management. 2004:15-29.