Evaluation Cookbook

cookbook logo
Route map: Home=>Publications=>Evaluation Cookbook=>Information Page
Questionnaires: Advantages and Disadvantages
 Main   Links page   References   Add comment 

>Info Pages

All lecturers come in contact with questionnaires whether it is the standard end of year course questionnaire or one that is used in research. These questionnaires come in many different forms from: factual to opinion based, from tick boxes to free text responses. Whatever their form, questionnaires are often viewed as quick and easy to do. This is not always the case. To get useful responses, in a cost-effective way, it is important to be clear about the aim of the questionnaire and how the responses will help you improve the learning technology or its implementation. Think also about the analysis of results. It can be sobering to consider the amount of data you will generate and the time it will take to analyse.

Some advantages and disadvantages of questionnaires follow. Notes on how to deal with some of the disadvantages are also provided, as are some references to more comprehensive information on questionnaires.

Some disadvantages of questionnaires:
o Questionnaires, like many evaluation methods occur after the event, so participants may forget important issues.
o Questionnaires are standardised so it is not possible to explain any points in the questions that participants might misinterpret. This could be partially solved by piloting the questions on a small group of students or at least friends and colleagues. It is advisable to do this anyway.
o Open-ended questions can generate large amounts of data that can take a long time to process and analyse. One way of limiting this would be to limit the space available to students so their responses are concise or to sample the students and survey only a portion of them.
o Respondents may answer superficially especially if the questionnaire takes a long time to complete. The common mistake of asking too many questions should be avoided.
o Students may not be willing to answer the questions. They might not wish to reveal the information or they might think that they will not benefit from responding perhaps even be penalised by giving their real opinion. Students should be told why the information is being collected and how the results will be beneficial. They should be asked to reply honestly and told that if their response is negative this is just as useful as a more positive opinion. If possible the questionnaire should be anonymous.

Some advantages of questionnaires:
o The responses are gathered in a standardised way, so questionnaires are more objective, certainly more so than interviews.
o Generally it is relatively quick to collect information using a questionnaire. However in some situations they can take a long time not only to design but also to apply and analyse (see disadvantages for more information).
o Potentially information can be collected from a large portion of a group. This potential is not often realised, as returns from questionnaires are usually low. However return rates can be dramatically improved if the questionnaire is delivered and responded to in class time.

John Milne
Centre for CBL in Land Use and Environmental Sciences,
Aberdeen University.

versions for printing are available

[ Main | Links | Add comment ]
[ Printable version ]
[ Contents | Information pages ]

© All rights reserved LTDI and content authors.
Last modified: 25 March 1999.