Thursday, September 2, 2010

Understanding the Use of Focus Group Discussions (FGDs)

Recently, I was asked to assist with a research project. The main aim of the research is to obtain prevalence rates for violence against children as well as the context in which they occur. The methodology proposed was the use of focus groups discussions (FGDs).
The original design estimated the number of interviews (sample size) that would be needed to be a representative of the larger population of children and parents. These samples sizes were then divided by 10, the average number of people in a FGDs, and the research project determined the number of FGDs that would be needed to obtain prevalence rates would be a total of 980 FGDs. Yes, 980 FGDs among children and parents on violence against children.
In addition, the research protocols stated that  the FGDs would:
  • recruit participants randomly
  • cover a wide range of issues
  • include confidentiality
  • not attempt to get individual accounts of violence
  • would solicit consensus on type and contexts of violence
  • data analysis would be completed in a short period of time
When I read the aims of the research project and that FGDs would be used as the main methodology and the protocols, I was quite shocked. Why? Here are the reasons.
  1. The sampling was based on individuals not groups. The sampling parameters (confidence interval, margin-of-error, etc.) would not be applicable once you took individuals and formed them into groups.
  2. FGDs findings can not provide prevalence rates nor be generalized of a larger population.
  3. Random sampling does not apply to FGDs; instead FGDs use either purposive or convenience samples. FGD participants are selected because of some common characteristic(s) not randomly.
  4. Generally, FGDs should focus on a few issues with sufficient time to "dig deeper" into these few issues rather than discussing a wide range of issues lightly.
  5. FGDs are not good for discussing sensitive issues such as child violence or exploitation, which is better handled in private interviews or in-depth interviews.
  6. FGDs cannot ensure confidentiality of what is discussed. FGDs organizers and the moderator cannot control what participants may tell others what was discussed in the FGDs afterwards.
  7. FGDs should solicit as many diverse opinions and views and NOT attempt to impose consensus.
  8. Data generated by FGDs are not cheap and easy to enter, analyze and interpret. Despite what may project staff think and/or believe, qualitative data entry and analysis must be systematic and rigorous and is as challenging to analyze as quantitative data.
  9. A good FGD requires an experience moderator and consistency across FGDs, which would be almost next to impossible with 980 FGDs. 
Anyone interested in the best practices of using FGDs should read, International Focus Group Research: a hanbook for the health and social sciences, by Monique Hennink.

4 comments:

  1. People misapply focus groups ALL the time - good to see you know the rules for good one!

    ReplyDelete
  2. I need information about the objective- based approach to assess the policy?

    ReplyDelete
  3. You could try some of Mark Schacter's articles - he has a good, practical outlook. One of them is "Not a “Tool Kit”: Practitioner’s Guide to Measuring the Performance of Public Programs" at http://www.schacterconsulting.com/docs/toolkit.pdf and another is at http://www.schacterconsulting.com/documents/trashing_000.pdf. You can find a review of several other of his articles at http://results-based-management.blogspot.com/2010/03/applying-rbm-to-policy.html

    ReplyDelete
  4. thank you very much for FGD information, we are trying our best all the time to keep on remembering it when we are in the field

    ReplyDelete