By December 1, 2013 4 Comments Read More →

What is regression analysis?

Adar Ben-Eliyahu - The Chronicle of Evidence-Based MentoringBy Adar Ben-Eliyahu, Ph.D.

In most of our research, we are interested in whether one variable of interest (e.g., relationship quality) predicts another (e.g., relationship satisfaction).  Although a correlation analysis can tell us whether the two variables are related, it can’t tell us whether mentoring quality leads to better outcomes.

In order consider predictive relations, we use regressions. While correlations quantify the extent to which one variable tends to change when another one changes, a regression fits a line into the represented data, as in the example below.

Screen Shot 2013-12-01 at 9.27.52 PM

 The regression analysis provides a beta coefficient (b), which captures the strength of the relation between the specific variables. When there is more than one predictor (or independent variable), a beta coefficient is provided for each variable pair. In addition to a beta, the regression provides an over estimate of the strength of the association. That is, how much of the change (or variance) in the outcome (mentoring satisfaction) is explained by the predictor (or set of predictors). This overall regression effect is R-squared (R2). 

Summary:

  • Regressions are similar to correlations in that they examine the relations between variables.
  • In addition to investigating the association, regressions allow for research to explore the strength of the relations between two variables.
  • Regressions can incorporate more than one predictor (e.g., relationship quality, youth age) of the outcome (e.g., satisfaction).
Posted in: Expert Corner

4 Comments on "What is regression analysis?"

Trackback | Comments RSS Feed

  1. Ijantiku, C. Moses says:

    You are a wonderful scholar I have met online, I must admit. Your team got what young academics need to succeed in their endeavors. Can you kindly inbox me your e-mail address? Thank you!

  2. Evan Cutler says:

    Hello Maryanne!

    Thank you for your feedback! From my background reading on blogging, social media engagement and search engine optimization (SEO), I can safely say that most business experts (eg. Hubspot) and professional bloggers completely agree with you in that a great title is of critical importance. We are also still learning and experimenting with how different titles and phrases are more easily found by people using Google search engine. In this case, the above blog post title “What is regression analysis?” is a very popular search phrase used in Google by people looking to find more information on regression analysis (Google drives *large* amounts of traffic to our website). On the other hand, the title is probably not so appealing to people who aren’t already looking for more information on regression. As I mentioned earlier, I tend to favor Hubspot, but if you have any favorite resources on the art and science of blogging/title creation please feel free to share. Thanks, Maryanne!

    – Evan Cutler, Assoc. Editor

  3. Adar Ben-Eliyahu says:

    Thank you Mark Liston!
    Any other topic that might be of interest to you?
    Best, Adar

  4. Mark Liston says:

    Superb, understandable summary of regression. Well-done!

Post a Comment