By October 13, 2014 5 Comments

On Methods: What’s the difference between qualitative and quantitative approaches?

adarEditors Note: We are very fortunate to have Adar Ben-Eliyahu, Ph.D. our new Methods Editor, sharing with us her considerable expertise on research methods. Dr. Ben-Eliyahu completed her doctorate in developmental psychology at Duke University, where she honed very strong skills in methods. She is currently a MacArthur Foundation Postdoctoral Fellow at the Center for Evidence-Based Mentoring at the University of Massachusetts in Boston. Prior to arriving at Boston, Dr. Ben-Eliyahu was a post-doc in the Activation Lab at the Learning Research & Development Center at the University of Pittsburgh. Enjoy!

Understanding different types of research:
What’s the difference between qualitative and quantitative approaches?

Adar Ben-Eliyahu, Ph.D.

In the world of research, there are two general approaches to gathering and reporting information: qualitative and quantitative approaches. The qualitative approach to research is focused on understanding a phenomenon from a closer perspective. The quantitative approach tends to approximate phenomena from a larger number of individuals using survey methods. In this research corner, I describe methods that are generally used in each strand of research. Each approach has its benefits and detriments, and is more suitable to answering certain kinds of questions.

Qualitative Approach

The qualitative approach to gathering information focuses on describing a phenomenon in a deep comprehensive manner. This is generally done in interviews, open-ended questions, or focus groups. In most cases, a small number of participants participate in this type of research, because to carry out such a research endeavor requires many resources and much time. Interviews can vary from being highly structured and guided by open-ended questions, or be less structured and take the form of a conversational interview. Because of the investment in this type of research and the relatively few number of participants, findings from qualitative research cannot be generalized to the whole population. However, such research serves as a spring board for larger studies and deeper understanding that can inform theory, practice, and specific situations.

Example from youth mentoring research:

Ahrens, DuBois, Garrison, Spencer, Richardson, & Lozano (2011) used semi-structured interviews to outline themes of mentor characteristics and factors that youth perceive to influence mentor relationships. They spoke with participants on the phone and asked them open-ended questions. In identifying barriers and facilitators for relationship initiation and maintenance, Ahrens et al. provide important points of inquiry to be used in a larger scale survey-based research. One of the cautions in using qualitative approaches is that the findings apply only to this small group of 23 individuals. This research was crucial in providing evidence that these factors should be examined and further elaborated through quantitative methods prior to making any wide-range recommendation.  (Click to read a summary of this study HERE).

Benefits of the qualitative approach:

Using open-ended questions and interviews allows researchers and practitioners to understand how individuals are doing, what their experiences are, and recognize important antecedents and outcomes of interest that might not surface when surveyed with pre-determined questions. Although qualitative research can be thought of as anecdotal, when pooled across a number of participants it provides a conceptual understanding and evidence that certain phenomena are occurring with particular groups or individuals.

  • Allows identification of new and untouched phenomena
  • Can provide a deeper understanding of mechanisms
  • Gives a one-on-one and anecdotal information
  • Provides verbal information that may sometimes be converted to numerical form
  • May reveal information that would not be identified through pre-determined survey questions

Limitations:

  • Cannot generalize to the general population
  • Challenges in applying statistical methods
  • Difficulty in assessing relations between characteristics

Quantitative Approach

The quantitative approach to gathering information focuses on describing a phenomenon across a larger number of participants thereby providing the possibility of summarizing characteristics across groups or relationships. This approach surveys a large number of individuals and applies statistical techniques to recognize overall patterns in the relations of processes. Importantly, the use of surveys can be done across groups. For example, the same survey can be used with a group of mentors that is receiving training (often called the intervention or experimental groups) and a group of mentors who does not receive such a training (a control group). It is then possible to compare these two groups on outcomes of interest, and determine what influence the training had. It is also relatively easy to survey people a number of times, thereby allowing the conclusion that a certain features (like matching) influence specific outcomes (well-being or achievement later in life).

Example from youth mentoring research:

Grossman and Rhodes (2002) examined duration of matched relationships in over 1,100 Big Brothers Big Sisters mentor-mentee matches. Because the information they used was survey-based and numerical, they were able to employ statistical techniques examining how duration of match was related to different outcomes of interest.

In using a variety of statistical techniques, they concluded that “youth who were in [matched mentoring] relationships that lasted a year or longer reported improvements in academic, psychosocial, and behavioral outcomes” (p. 213). If Grossman and Rhodes had not used survey-based quantitative research, they would not have had such a large sample of matches and therefore could not generalize to matches in general. In addition, with a smaller number of participants, it is challenging to apply some statistical techniques to examine emerging patterns across such a large group of mentored matches. The current rule of thumb to using complex statistical modeling is that you need a sample of at least 130 participants. However, for more complex modeling that controls for characteristics, a larger pool of participants is needed.

Benefits of the quantitative approach:

Using survey methods across a large group of individuals enables generalization. For example, if policy makers wanted to instantiate a policy about mentor training, they would likely require some evidence that this training actually works. Interviewing a few individuals, or conducting a focus group with forty matches, might be reflective of specific cases in which the mentoring training worked, however, it would not provide strong evidence that such training is beneficial overall. Stronger support for successful training would be evident if using quantitative methods.

  • Enables gathering information from a relatively large number of participant
  • Can conduct in a number of groups, allowing for comparison
  • Allows generalizing to broader population
  • Provides numerical or rating information
  • Informative for instantiating policy or guidelines
  • Lends to statistical techniques that allow determining relations between variables (think of better word)

Limitations:

  • Difficulty in recognizing new and untouched phenomena
  • Caution in interpretation without a control group

In summary, the qualitative and quantitative approaches to research allow a different perspective of situations or phenomena. These two main approaches to research are highly informative, especially if used in combination. Each approach has its benefits and detriments, and being aware of the methods used to gather information can help practitioners and policy-makers understand the extent to which research findings can be applied.

More straightforward explanations to essential research concepts & terms:

 

5 Comments on "On Methods: What’s the difference between qualitative and quantitative approaches?"

Trackback | Comments RSS Feed

  1. rabiya says:

    very useful, thanks a lot!

  2. Nilsa Fleury says:

    It is a very interesting approach that could clarify my research that I have done and apply to my dissertation sbout mentoring. Thank you,
    Nilsa

  3. Moti says:

    Adar, I enjoyed much your article and the classification you made is very important in my opinion.
    It seems that quantitative approach should follow the qualitative approach. Only careful selection of the variables of the qualitative analysis will result better quantitative results. The selection of the right variables will be based on a small sample of individuals that will help with identifying the proper variables or the promising ones to go through the analysis that could lead to selected action or treatment.
    I would like to see more of articles in the area of analysis.

    • Adar says:

      Thank you for your comment, Moti.
      I think that in general, you are right that using qualitative research to inform quantitative research design is a good idea. However, researchers and practitioners don’t always have the means to do so. In these cases, choosing variable or characteristics based on research that has already been conducted is a good idea, and can be quite informative and efficient.
      Best, Adar

  4. Evan Cutler says:

    Hello Armando,

    Thanks for your questions! No, you are not stupid. :-) You are taking the initiative to educate and teach yourself about research concepts that can be quite confusing.

    The quantity or amount of sources you use is not a criteria that will define whether the research is qualitative or quantitative.

    In general, when you see data that is something other than numbers (ie. interviews, personal diaries, witness testimonies) you’re looking at qualitative data.

    When you see data that consists of numbers or measurements of some kind, you’re looking at quantitative data.

    In your example, I’m assuming (I don’t know much about water-based ore transportation networks…) the data you will be looking at will be expenses from the mining and shipping of ore and the profit from selling the ore, and possibly the future demand for ore. As long as you’re measuring and comparing numbers you’re using a quantitative approach.

    What if you don’t know what makes for a successful transportation system? What if nobody has conducted research to answer this question? Then you might start your investigation by interviewing experts in the business and asking them what they *think* makes a successful transportation system. After analyzing those interviews for common themes or answers to your questions you’ll then be better prepared to use a quantitative approach because you will have an idea as to what to measure/compare.

    Hopefully that helps?

    - Evan Cutler, Assoc. Editor

Post a Comment

*