FAQs
What makes Welphi different from any other questionnaire system?
There are two obvious ways to ask the opinion of a set of people: join everyone in a room or set up an online questionnaire. While we think the former will always be the best way to foster the debate and exchange of arguments between people, it lacks the flexibility required to join people often geographically disperse and with tight schedules. Additionally, it makes no sense when the number of participants is very high. The later, on the other way, overcomes the problems of having many people at the same time in a room but makes it impossible to share people’s opinions. This is where Welphi comes handy. It not only provides the online resources to set up a questionnaire where each participants can answer it his own pace and place, but it also makes it possible to share participants answers and comments and ultimately allow any participant to change his/her answer after getting feedback from his peers.
Can I use Welphi to set up a questionnaire/survey without using the Delphi method?
Yes. If you only set up 1 round and choose to not allow users to comment on their answers you will be setting a normal questionnaire just like any platform does.
Can I create a new round based on the previous one?
Yes. When the current round has finished, click "STOP" to close it, then click "NEW ROUND +" in your process. Welphi copies all pages and questions of the previous round, with its results, into the new round.
What participants see in the new round
- On Qualitative pages: the percentage of participants who chose each level, which they can switch to absolute numbers ("Show stats as: PERCENTAGE / ABSOLUTE").
- On simple Quantitative questions: the mean, median, Q25, Q75 and standard deviation, and a chart of the answers.
- Other participants' comments, always anonymous.
Participants can then confirm or change their answers.
What you see
On Qualitative pages, the "Round results" page in the back office shows the sample size, frequencies, mean, mode, median and IQR, the consensus level and your approval/rejection rules. From round 2 onwards it also shows whether each item is stable between rounds (Wilcoxon signed-rank test: "Stable" / "Unstable").
What you can change before starting the new round
- Delete items, for example those that already reached consensus.
- Reword items, for example based on participants' comments.
- Add new items.
Earlier rounds are not affected: each round keeps its own pages, wording and answers, and you can export it at any time.
What is a round in Welphi?
Every time you want to get the answers from the participants you want to invite, you need to set up a round. A round begins when you invite participants, and ends when you decide you have enough answers. Once the first round is finished, you can use Welphi’s tools to analyse the data. After this, you can set up another round so that participants are allowed to see the statistics of the other users’s answers as well as the comments they may have written. The goal is that, through several rounds, the group can get closer to a consensus.
What are the “elements” used in Welphi?
Welphi can be used to help someone get feedback from experts/participants regarding a particular subject where he/she requires a validation of some elements. These elements can be:
- 1 – Indicators to used in the construction of an index;
- 2 – Goals to be set for a department or company;
- 3 – Events or scenarios which likelihood you want to access;
- 4 – Criteria to used in the evaluation of drugs;
- 5 – Key performance Indicators for performance measure
- 6 – Places where you want to go next holydays.
Anything you can think of…
Is there a limit on the number of elements (Criteria, Indicators, Objectives, etc) I can set up?
No. To help the questionnaire be cleaner to the participants, you can add category field to the elements to aggregate them in groups. Imagine you are asking validation about criteria to build an index, you can add a field named “Area” and define to each area does each criterion belong. This way, the questionnaire will be splitted in a screen for each area thus making it much easier for participants to answer.
Can I keep track of the participants' answers on a specific round?
Yes, at any time, even while the round is open.
- Progress: on the Round details screen, click "ROUND STATUS AND INVITATIONS" to see each participant's status on every page ("Entered", "Completed") and the date and time of each status.
- Answers: click the pie-chart icon ("View page analysis") next to a page to see every participant's answers, or click "EXPORT" to download all answers submitted so far.
Answers are shown under a randomly generated Alias, so participants stay anonymous, unless you check "Reveal the real identities of participants when viewing questionnaire responses" in Process settings.
Which Welphi plan do I need, and is there a limit on the number of participants?
Each plan sets the maximum number of panelists per process (one process = one Delphi study, with as many rounds as you need):
- Basic – up to 100 panelists
- Plus – up to 1,000 panelists
- Premium – up to 10,000 panelists
- Exclusive – unlimited panelists and custom options; contact us
You can add or remove participants at any time, as long as you stay within your plan's limit.
Every plan includes unlimited processes and rounds, Delphi Qualitative pages (rating scales with comments), automatic statistics between rounds, invitation and reminder e-mails, progress monitoring and data export (.csv). As process admin, you can also filter your results by group on every plan.
Plus adds:
- Survey pages;
- Informed consent pages.
Premium adds:
- participants proposing new items on Qualitative pages;
- Delphi Quantitative pages, for questions answered with a number;
- Delphi Ranking pages, where participants order items by dragging them;
- automatic charts;
- the live forum/chat;
- rules to control the questionnaire flow;
- statistics filtering for participants, so they can filter the previous round's results by group (for example, by country or area of expertise).
Which one to choose: a study with rating-scale questions only can start with Basic. Choose Plus if you need a consent page or background questions (Survey pages), and Premium for ranking or numeric questions, charts, flow rules, a forum, or to let participants filter results by group.
You can try Welphi free for 14 days, with no credit card required.
You can change plan during your study, for example upgrade to Premium only for the month of your ranking round. See the plans and prices on the pricing page.
Is there a limit on the number of rounds I can create in each process?
No.
Can I add participants in the middle of a round?
Yes. You can change add and remove participants at any time
Does my subscription renew automatically?
Yes. Subscriptions paid by card renew every month and are charged to the same card until you cancel. To cancel, click your name at the top right, open "Subscription" and click "CANCEL SUBSCRIPTION". The same page shows your plan ("Subscription type") and the date it runs until ("Subscription date limit"). When you cancel, you keep full access until the end of the period already paid.
Can I pay for a whole year, or by invoice or purchase order?
Yes. Contact us with the plan, the period and the start date you need. You can pay the whole period at once by card, through a secure payment link, or by bank transfer against an invoice. For the invoice, send us your organisation's name, billing address, VAT number (if it has one) and any purchase order reference.
Can I pause my subscription?
Yes, at no extra cost, and nothing is deleted. If you pay by card, you can pause your subscription yourself in your Welphi account and reactivate it when you are ready; otherwise, contact us. While it is paused, you and your participants can't open your processes, so pause between rounds rather than during an open round.
Can I change plan during my study?
Yes. For example, you can upgrade to Premium only for the month of your ranking round and go back to your previous plan afterwards. To upgrade, click "UPGRADE" at the top of any page: it opens the pricing page, where you choose the plan ("Sign Up"). If you pay by card, you can also change plan yourself in your Welphi account; otherwise, contact us.
Do you refund unused time?
No, we don't refund the unused part of a period already paid. If you were charged by mistake, for example twice, contact us and we'll sort it out.
What happens to my data when my subscription ends?
Your processes, participants and answers stay in your account: to view or export them again, reactivate a subscription. Accounts without a paid subscription are deleted after 5 years of inactivity. We recommend exporting your round data and participants status before your subscription ends.
Where are Welphi data hosted, and is Welphi GDPR compliant?
Welphi is developed and operated by Decision Eyes, Lda, in Lisbon, Portugal, and is designed for GDPR-compliant research.
Hosting: all data – questionnaires, participants and answers – are hosted by Amazon Web Services in the EU (Frankfurt, Germany). Data are encrypted in transit (TLS) and at rest (AES-256), and backed up twice a day.
E-mails: invitations, reminders and account e-mails are delivered by Mailchimp under the EU–U.S. Data Privacy Framework. To keep all participant data in the EU, send invitations from your own e-mail: on the "ROUND STATUS AND INVITATIONS" page, click "LOAD PARTICIPANTS LINKS" and copy each participant's link.
Data processing agreement: you (or your institution) are the data controller and Decision Eyes is the data processor. We sign a data processing agreement on request: write to info@welphi.com.
Who can see your data:
- Only the users of your Welphi account. You can turn on two-factor login (authenticator app or e-mail code).
- Participants never see other participants' names or e-mail addresses; results and comments in later rounds are anonymous.
- You see answers under a random Alias unless you check "Reveal the real identities of participants when viewing questionnaire responses" (this cannot be undone).
- Decision Eyes staff access is restricted, protected by multi-factor authentication and logged.
Retention: your data stay in your account until you delete them or ask us to. Data in accounts without a paid subscription are deleted after 5 years of inactivity.
Read our Terms and Conditions.