Section: Module 5: Regression Analysis | Biostatistics | NextGenU.org

  • Competencies covered in this module:
    1. Apply common statistical methods for inference.
    2. Apply descriptive and inferential methodologies according to the type of study design for answering a particular research question.
    • In the previous module, we learned methods we could use to decide whether to reject a null hypothesis based on the evidence we have. However, what if we want more than a simple yes/no answer and wish to precisely predict how the outcome changes as the predictors change? This is the reason we use regression models, as we will learn in this module. This module has four lessons, and the division is based on the nature of the outcome variable: if it is a continuous variable, we use simple or multiple linear regression; if it is a binary categorical variable, we use logistic regression. These represent some very common and basic statistical models; there are many more regression methods in the field, but learning the basic concepts well will help you quickly pick up other methods when you need to. You will notice that some concepts cross over from epidemiology, such as risk, odds, confounding, bias, etc. It is helpful to possess some prior knowledge in epidemiology, but if you don’t, these concepts will also be explained in this module.

      Resources on regression can vary a great deal in their depth and complexity. Don’t let the math scare you. Focus on the main ideas to start, and add the mathematical details as you continue progressing in the topic.

      The learning activity in this module asks you to go through some regression models. Even more so than hypothesis testing, the tedious calculation parts are done by the computer, but you will need to answer questions about the model and about using the model. These are essential skills that you will need in order to understand research literature and reports.

      Upon completion of this module, students should be able to:

      • Understand linear relationships, outliers, and the basics of correlation
      • Understand the difference between correlation and simple linear regression, and when to apply one or the other
      • Understand homoscedasticity and its applications to correlation and regression
      • Understand linear regression and how it relates to prediction
      • Understand multiple linear regression and its applications
      • Understand simple logistic regression analysis
      • Understand multiple logistic regression analysis and distinguish between adjusted and unadjusted regression coefficients
      • Be able (1) to distinguish between risks, e.g., absolute and relative risks, as well as odds and odds ratios, and (2) to differentiate relative risks from odds ratios and know how to conduct both methods
      • Be able (1) to distinguish between correlation, linear and multiple regression, and logistic regression, and (2) to understand the purpose and methods of linear (simple and multiple) and logistic regression, including when to use each of them
      • Be able to specify regression models and interpret regression results
    • Module 5: Lesson 1: Simple Linear Regression Analysis
       
      Student Learning Objectives:

      Upon completion of this lesson, you will be able to:

      • Understand linear relationships, outliers, and the basics of correlation.
      • Understand the difference between correlation and simple linear regression, and when to apply one or the other.
      • Understand homoscedasticity and its applications to correlation and regression.
      • Understand linear regression and how it relates to prediction.

      Approximate time required to complete the readings (at 144 words/minute) and assignments for this module: 5 hours.

       
      Required Learning Resources and Activities
      • Download the PDF version of the text by clicking on the appropriate link.  Then, in Chapter 12 titled "Linear Regression and Correlation", read the introductory section along with sections 12.1, 12.2, 12.3, and 12.6 (pages 679-691 and 697-704).
      • Understand linear relationships, outliers, and the basics of correlation

      • Read down to the beginning of the section titled "How the test works".
      • Understand the difference between correlation and simple linear regression, and when to apply one or the other

      • Read the web page as well as sections 1.2 and 1.3. Access sections 1.2 (What is the "Best Fitting Line"?) and 1.3 (The Simple Linear Regression Model) by clicking on the titled links found on the left side of the web page.
      • Understand the difference between correlation and simple linear regression, and when to apply one or the other

      • Read the entire article.

      • Read the web page as well as sections 2.1 to 2.5. Access sections 2.1 (Inference for the Population Intercept and Slope), 2.2 (Another Example of Slope Inference), 2.3 (Sums of Squares), 2.4 (Sums of Squares (continued)), and 2.5 (Analysis of Variance: The Basic Idea) by clicking on the titled links found on the left side of the web page.
      • Understand the difference between correlation and simple linear regression, and when to apply one or the other

      • Scroll down and read the section titled "Assumptions" to understand the definition of Homoscedasticity.
      • Understand homoscedasticity, and its applications to correlation and regression

      • Read the web page as well as sections 3.1 to 3.3. Access sections 3.1 (The Research Questions), 3.2 (Confidence Interval for the Mean Response), and 3.3 (Prediction Interval for a New Response) by clicking on the titled links found on the left side of the web page.
      • Understand linear regression and how it relates to prediction

      • Read the web page as well as sections 4.1 to 4.8. Access sections 4.1 (Background), 4.2 (Residuals vs. Fits Plot), 4.3 (Residuals vs. Predictor Plot), 4.4 (Identifying Specific Problems Using Residual Plots), 4.5 (Residuals vs. Order Plot), 4.6 (Normal Probability Plot of Residuals), 4.7 (Assessing Linearity by Visual Inspection), and 4.8 (Further Examples) by clicking on the titled links found on the left side of the web page.
      • Understand linear regression and how it relates to prediction

    • quiz icon
      Quiz: Module 5: Lesson 1

      To access the quiz, click on the name of the quiz provided above. On the following screen, click the "Preview quiz now" button to respond to the questions.

      TO PASS THIS QUIZ, YOU MUST OBTAIN A SCORE OF 80% 

      Not available unless: The activity Quiz: Module 4: Lesson 4 is marked complete
    • Additional Learning Options
      • Download the PDF version of the text by clicking on the appropriate link.  Then, read sections 12.4 and 12.5 titled "Testing the Significance of the Correlation Coefficient" and "Prediction" respectively (pages 691-697).

    • Module 5: Lesson 2:  Multiple Linear Regression Analysis
       
      Student Learning Objectives:

      Upon completion of this lesson, you will be able to:

      • Understand multiple linear regression and its applications.

      Approximate time required to complete the readings (at 144 words/minute) and assignments for this module: 1 hour.

       
      Required Learning Resources and Activities
      • Scroll down to the heading titled "Module 2: Linear Regression", and click on the PDF links to parts A to E of Lecture 5 (Relating a Continuous Outcome to More than One Predictor: Multiple Linear Regression).  Read the slides.  An audio recording of the presentation is also available.  
      • Understand multiple linear regression and its applications

      • Read the web page as well as sections 5.1 to 5.3. Access sections 5.1 (Example on IQ and Physical Characteristics), 5.2 (Example on Underground Air Quality), and 5.3 (The Multiple Linear Regression Model) by clicking on the titled links found on the left side of the web page.
      • Understand multiple linear regression and its applications

    • quiz icon
      Quiz: Module 5: Lesson 2

      To access the quiz, click on the name of the quiz provided above. On the following screen, click the "Preview quiz now" button to respond to the questions.

      TO PASS THIS QUIZ, YOU MUST OBTAIN A SCORE OF 80% 

      Not available unless: The activity Quiz: Module 5: Lesson 1 is marked complete
    • Module 5: Lesson 3:  Logistic Regression Analysis
       
      Student Learning Objectives:

      Upon completion of this lesson, you will be able to:

      • Understand simple logistic regression analysis.
      • Understand multiple logistic regression analysis and distinguish between adjusted and unadjusted regression coefficients.
      • Be able (1) to distinguish between risks, e.g., absolute and relative risks, as well as odds and odds ratios, and (2) to differentiate relative risks from odds ratios and know how to conduct both methods.

      Approximate time required to complete the readings (at 144 words/minute) and assignments for this module: 4 hours.

       
      Required Learning Resources and Activities
      • Read the entire article.

      • Read the entire article.

      • Read the web page (section 15.1) as well as sections 15.2 to 15.3. Access sections 15.2 (Polytomous Regression) and 15.3 (Further Logistic Regression Examples) by clicking on the titled links found on the left side of the web page.
      • Understand multiple logistic regression analysis and distinguish between adjusted and unadjusted regression coefficients

      • Read the entire article.
      • Be able (1) to distinguish between risks, absolute and relative risks, as well as odds and odds ratios, and (2) to differentiate relative risks from odds ratios and know how to conduct both methods

      • Read the entire article.
      • Be able (1) to distinguish between risks, absolute and relative risks, as well as odds and odds ratios, and (2) to differentiate relative risks from odds ratios and know how to conduct both methods

      • Read the entire web page.
      • Be able (1) to distinguish between risks, absolute and relative risks, as well as odds and odds ratios, and (2) to differentiate relative risks from odds ratios and know how to conduct both methods

    • quiz icon
      Quiz: Module 5: Lesson 3

      To access the quiz, click on the name of the quiz provided above. On the following screen, click the "Preview quiz now" button to respond to the questions.

      TO PASS THIS QUIZ, YOU MUST OBTAIN A SCORE OF 80% 

      Not available unless: The activity Quiz: Module 5: Lesson 2 is marked complete
    • Additional Learning Options
      • Read the web page (section 15.4) as well as sections 15.5 to 15.8. Access sections 15.5 (Generalized Linear Models), 15.5 (Nonlinear Regression), 15.7 (Exponential Regression Example), and 15.8 (Population Growth Example) by clicking on the titled links found on the left side of the web page.

    • Module 5: Lesson 4: Overview of Correlation and Regression Analysis
       
      Student Learning Objectives:

      Upon completion of this lesson, you will be able to:

      • Be able (1) to distinguish between correlation, linear and multiple regression, and logistic regression, and (2) to understand the purpose and methods of linear (simple and multiple) and logistic regression, including when to use each of them.
      • Be able to specify regression models and interpret regression results.

      Approximate time required to complete the readings (at 144 words/minute) and assignments for this module: 1 hour.

       
      Required Learning Resources and Activities
      • Read the entire article.
      • Be able (1) to distinguish between correlation, linear and multiple regression, as well as logistic regression, and (2) to understand the purpose and methods of linear (simple and multiple) and logistic regression including when to use each of them

      • The fitted equation from a study on infant head circumference is as follows:


      head circumference = 1.76 + 0.86×gestational age - 2.82×toxemia

      + 0.046×(gestational age×toxemia)


      where gestational age is measured in weeks and toxemia is an indicator variable for the mother’s toxemia status during pregnancy (1=had toxemia).

          • For infants whose mothers did not have toxemia during pregnancy, what is the effect of an extra two weeks of gestation? What about for those whose mothers had toxemia?
          • What other information or calculations would you need to decide whether to include this effect in the final model?
          • What effect does the last term represent? How would you interpret this effect?

      • Be able to specify regression models and interpret regression results

      • Consider the following hypothetical scenario: Two experimental treatments (A and B) are administered to patients having just suffered a stroke.  After a few months, the following data is obtained (Table 1). A multivariate logistic regression model is later constructed from this data (Table 2). Answer questions 1-9 based on this information.


      Table 1: Effect of treatment on stroke survival by smoking status

      Patients


      Treatment A

      Treatment B

      Total

      Non-smokers

      No. of deaths

      46

      8

      54

      No. of survivors

      105

      37

      142

      Total

      151

      45

      196

      Smokers

      No. of deaths

      105

      15

      120

      No. of survivors

      160

      81

      241

      Total

      265

      96

      361



      Table 2: Results from a multivariate logistic regression based on data from Table 1 (Reference group = non-smokers, treatment B)

      Parameter

      Fitted value of β

      Intercept
      (Ref. group: non-smoker, treatment B)  

      β0 = -1.856

      Smoking status

      β1 = 0.314

      Treatment option

      β2 = 1.090



      Questions

      1. From Table 1, calculate the odds ratio of death for non-smokers under treatment A .
      2. From Table 1, calculate the odds ratio of death for smokers under treatment B.
      3. Explain in words what these odds ratios mean.
      4. From Table 2, write the corresponding multivariate logistic regression equation. Indicate what the variables mean and which values they can take.
      5. Calculate the odds of death and the probability of death for non-smokers under treatment B.
      6. Calculate the odds of death and the probability of death for smokers under treatment B.
      7. Calculate the odds of death and the probability of death for non-smokers under treatment A.
      8. Calculate the odds of death and the probability of death for smokers under treatment A.
      9. What is the sum of all the probabilities?
      • Be able to specify regression models and interpret regression results

    • quiz icon
      Quiz: Module 5: Lesson 4

      To access the quiz, click on the name of the quiz provided above. On the following screen, click the "Preview quiz now" button to respond to the questions.

      TO PASS THIS QUIZ, YOU MUST OBTAIN A SCORE OF 80% 

      Not available unless: The activity Quiz: Module 5: Lesson 3 is marked complete
    • Additional Learning Options
    • resource icon
      Answer key. Linear regression problem 1 File
      Not available unless: The activity Peer Activity 7: Linear Regression Problem 1 is marked complete
    • resource icon
      Answer key. Linear regression problem 2 File
      Not available unless: The activity Peer Activity 8: Linear Regression Problem 2 is marked complete