Further Reading: Applying Regression and Correlation

Go Back to
Jeremy Miles's Homepage
Books by Jeremy Miles
Applying Regression and Correlation Homepage
   

This section of the site contains a revised  further reading section from each chapter in the book.  It will be updated from time to time to keep up to date with new books that are published, or that we become aware of.
The column on the right hand side contains links to the book to amazon.com (based in the US) and amazon.co.uk (based in the UK).  Pick whichever is closer to you.  It also contains a link to any information that we have found on the publisher's page, which may contain additional information, such as a table of contents.  It is often possible to buy the book directly from the publisher.
If you have suggestions for additional sources that we have not included here, please email: book-suggestions@jeremymiles.co.uk
Last update: September 1st, 2005
Note: Sage have changed all their websites.  We are working on updating the links.

Contents

Chapter 1: Building Models With Regression And Correlation
Chapter 2: More Than One IV - Multiple Regression
Chapter 3: Categorical Independent Variables
Chapter 4: Assumptions In Regression Analysis
Chapter 5: Issues in Regression Analysis
Chapter 6: Non-linear And Logistic Regression
Chapter 7: Moderator And Mediator Analysis
Chapter 8: Introducing some advanced techniques: multilevel modelling and structural equation modelling

Chapter 1: Building Models With Regression And Correlation

For further details about how regression analysis minimises the sum of the squared deviations from the mean, see Judd and McLelland (1989) 'Data Analysis: a model comparison approach,' Chapter 1. Cohen and Cohen (1983) 'Applied multiple regression/correlation analysis in the behavioural sciences' Chapter 1, contains more information on how the correlation is calculated, and Allison (1999) 'Multiple regression: a primer'  is a nice introduction to many aspects of regression analysis, with a question and answer format throughout.
A book which has recently come to our attention is McClelland (1999) 'Seeing statistics.'  This book comes with a series of web-based demonstrations of statistical phenomena, which can help the reader to see what is going on.

Book Links

Judd and McClelland (1989) is a little tricky to get hold of, although a second edition is in preparation.  There is some information on Charles Judd's homepage.    You can also see  Gary McClelland's homepage .

In the book we cite Cohen and Cohen (1983), however a 3rd edition has now been published.  It is now in its third edition, and is authored by Cohen, Cohen, Aiken and West (2002) [amazon.co.uk ] [ amazon.com ] [publisher site]

Allison (1999) -[ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )].

McClelland (1999) - [ amazon.co.uk ] [ amazon.com ] [Book web page]

Chapter 2: More Than One IV - Multiple Regression

Cohen, Cohen, AIken and West (2002) 'Applied multiple regression/correlation analysis in the behavioural sciences' Chapter 3 (this is a new edition).
Pedhazur (1997)  'Multiple regression in behavioural research' Chapter 7.
An interesting book to read on multiple regression is Berk (2003) 'Multiple regression: a constructive critique'.  It takes, as it says, a critical look at the use and abuse of multiple regression.

Book Links

Cohen, Cohen, Aiken and West (2002) [amazon.co.uk ] [ amazon.com ] [publisher site]

Berk (2002)[amazon.co.uk] [ amazon.com ] [publisher site]

Pedhazur - [ amazon.co.uk] [amazon.com ] [publisher site]

Chapter 3: Categorical Independent Variables

Fox (1991) 'Regression diagnostics'  and 'Berry (1993) 'Understanding regression assumptions'  are both short books, which contain exactly what they say on the cover. Tukey (1977) 'Exploratory data analysis' is an excellent, and highly detailed, text about different techniques for exploring data, checking for outliers, doing distribution checks.  The Tukey book is a little out of date though (it assumes that you will not be using a computer, and it's pretty pricey.)

Book Links

Fox (1991) - [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )].
Berry (1993) - [ amazon.co.uk ] [ amazon.com ] [publisher (Sage)].
Tukey (1977) - - [ amazon.co.uk ] [ amazon.com ] [We couldn't find it on the publisher page ( Addison Wesley )].

Chapter 4: Assumptions In Regression Analysis

Causality is covered in Bollen (1989) 'Structural equations with latent variables,'  Chapter 3, Maxwell and Delaney (2003) 'Designing experiments and analysing data,' (this is a new edition) Chapter 1. Shadish, Cook and Campbell (2001) Experimental and Quasi-experimental Designs' (this is a new edition).

New
Books that have come out since we finished the book.

Pearl (2000).  'Causality: Models, reasoning and inference' takes a rather mathematical look at causality.  If you go to the publisher home page you can download a sample chapter, and get more details. 

Book Links

Bollen (1989) - [ amazon.co.uk ] [ amazon.com ] [publisher (Wiley )].
Maxwell and Delaney (1990) - [amazon.co.uk] [amazon.com] [publisher website ].
Shadish, Cook and Campbell (2001) - [ amazon.co.uk ] [ amazon.com ] [Publisher website.]
Pearl (2000).  [ amazon.co.uk ] [ amazon.com ] [ publisher (Cambridge University Press )].
 

Chapter 5: Issues in Regression Analysis

Power analysis is covered in general in Cohen (1988) 'Statistical power analysis for the behavioral sciences,'  Kraemer and Thiemann (1987) 'How many subjects? Statistical power analysis in research.'  Specifically regarding regression analysis, see Cohen, Cohen, AIken and West (2003) 'Applied Multiple Regression / Correlation Analysis for the Behavioural Sciences (this is a new edition).

Collinearity is covered in Fox (1991) 'Regression diagnostics' Chapter 3 and Pedhazur (1997) 'Multiple regression in behavioural research' Chapter 7.

Measurement error is covered very thoroughly in Bollen (Bollen (1989)' Structural equations with latent variables,' Chapter 5 and more briefly in Berry (1993). Understanding regression assumptions Chapter 5.
 

New Books

A new book has come out, by Murphy and Myors (2003) Statistical Power Analysis: A Simple and General Model for Traditional and Modern Hypothesis Tests  This might qualify as our favourite book on power analysis.

Book Links

Cohen (1988) - [ amazon.co.uk] [ amazon.com] [publisher (Erlbaum )].

Kraemer and Thiemann (1987) - [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )].

Cohen, Cohen, Aiken and West (2002) [amazon.co.uk ] [ amazon.com ] [publisher site]

Fox (1991) - [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )].

Pedhazur - [ amazon.co.uk ] [ amazon.com ] [We couldn't find it on the publisher page Harcourt Brace .]

Bollen (1989) - [ amazon.co.uk ] [ amazon.com ] [publisher (Wiley )].

Berry (1993) - [ amazon.co.uk ] [ amazon.com ] [publisher (Sage)]

Murphy and Myors (2003) - [amazon.co.uk] [amazon.com] [publisher website]

Chapter 6: Non-linear And Logistic Regression

For non-linear regression, see Pedhazur (1997) 'Multiple regression in behavioural research' Chapter 13.
For logistic regression see Hutcheson and Sofreniou (1999) 'The multivariate social scientist: introductory statistics using generalised linear models' or Menard (1995) 'Applied logistic regression analysis.' 0803957572

Book Links

Pedhazur - [ amazon.co.uk] [amazon.com ] [publisher site]

Hutcheson and Sofreniou (1999)  [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )].

Menard (1995) [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )]

Chapter 7: Moderator And Mediator Analysis

Moderators are covered in two books devoted to the topic: Jaccard, Turrisi and Wan (2003) 'Interaction Effects in Multiple Regression'  (this is a new edition) and Aiken and West (1991) 'Multiple regression: testing and interpreting interactions.' 

Mediators are covered in Cohen, Cohen, AIken and West  (2002) 'Applied Multiple regression/ Correlation Analysis for the Behavioural Sciences' (this is a new edition).
 

Book Links

Jaccard, Turrisi and Wan (2003) [amazon.co.uk] [ amazon.com ] [ publisher (Sage )].

Aiken and West (1991) [ amazon.co.uk ] amazon.com ] [ publisher (Sage )].

Cohen, Cohen, Aiken and West (2002) [amazon.co.uk ] [ amazon.com ] [publisher site]

Chapter 8: Introducing some advanced techniques: multilevel modelling and structural equation modelling

MultiLevel Modelling (MLM) 

MLM is a relatively new technique and so few textbooks cover it. At the time of writing, there are six books that we know of, which are specifically about MLM.

Snijders and Bosker (1999) 'Multilevel analysis: an introduction to basic and advanced multilevel modelling'  Hox (1995) 'Applied multilevel analysis,'  Kreft and De Leeuw (1998) 'Introducing multilevel modelling', are all good introductory texts, for the beginner. (Hox is currently out of print, but is available as a free download from Hox's web site.)

Bryk and Raudenbush (1992) 'Hierarchical Linear Models: Applications and Data Analysis Methods'  provide a more detailed and elaborate treatment of the use of multilevel models, and also makes more demands of the reader's mathematical and statistical knowledge.

Goldstein (1995) 'Multilevel Statistical Models'  and Longford (1993) 'Random coefficient models'  are more advanced texts, and provide more mathematical details.

Structural Equation Modelling

SEM has been around a lot longer than MLM, so there are many more texts available which deal with it. We will mention three types of text - introductory texts, suitable for beginners, advanced texts, and texts with deal with specific issues.
Introductory Texts
Loehlin (2004) 'Latent variable models (4th Ed)' is our favourite introductory text - now in its fourth edition, it relates SEM to regression analysis and factor analysis, showing the clear links between them.

Schumacker and Lomax (1996). 'A beginner's guide to structuralequation modeling'  is another excellent introductory text. It is a little more computer oriented than the other books for beginners - spending longer examining what to actually tell the computer and looking at output than, for example, Loehlin's text.

Hayduk (1988). 'Structural equation modeling with LISREL: essentials and advances'  focuses mainly on LISREL, although is actually a nice introduction to SEM. It is more about SEM than how to actually use LISREL.

Hoyle (Ed, 1995). 'Structural Equation Modeling Concepts, Issues, and Applications' . This is a very nice book, ideal for people just beyond the beginner stage in structural equation modelling. It contains chapters on the sorts of issues that people are likely to encounter once they start to use SEM 'in anger'. It also includes a very useful chapter on writing about structural equation models, and several chapters of examples of applications.

New
Books in this section are not mentioned in the book, usually because they are too new, or occasionally because were were unaware of them.

Kaplan (2000) has written a book on SEM in the Sage Advanced Quantitative Techniques in the Social Sciences, called "Structural equation modelling: foundations and extensions."  .
 
 
 

Advanced Texts


Bollen (1989) 'Structural Equations with Latent Variables' is beginning to show its age a little, although it remains a classic. It is fairly heavy going, but has discussion of issues such as identification, and measurement error that it would be difficult to find anywhere else.

Hayduk (1996) 'LISREL Issues, Debates, and Strategies.' Not everyone will agree with everything Hayduk says - his opinions tend to be strongly held and not necessarily consensual non-consensual. (See the January 2000 issue of the journal 'Structural equation modelling' for more evidence of this. This book is not for beginners, but raises interesting issues for people who want to know more about SEM.

Long (1983a and 1983b) 'Confirmatory Factor Analysis :A Preface to LISREL'  and 'Covariance Structure Models : An Introduction to LISREL'  are two books in the Sage 'Quantitative Applications in the Social Sciences' (or 'Little Green Books,' as they are more familiarly know) are both showing their age a little, but are fairly nice concise introductions to LISREL.

Marcoulides and Schumacker (Eds; 1996). 'Advanced structuralequation modelling: issues and techniques.'  The title tells you almost everything you need to know - this is an advanced text on SEM, so it is not for beginners. Its technical level is not completely impenetrable and a number of chapters are excellent sources of information on diverse topics.

Specific Topics
Bollen and Long (Eds.; 1993).  'Testing Structural Equation Models' is an amazingly useful book containing information on, well, testing structural equation models. In a range of chapters it describes not only the how standard fit indices are calculated and what they mean, but also the interpretation of different fit indices, and the general philosophybehind deciding whether a model 'fits'.

Jaccard and Wan (1996). 'LISREL approaches to interaction effects in multiple regression.'  Another of the Sage 'little green books' this book focuses on methods of implementing interaction effects using LISREL. Like almost all of the little green books, it has a very process driven approach to the subject, and is clearly written. Be warned though, that the issue is not an easy one.

 

Book Links

Snijders and Bosker (1999)  [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )].

Hox (1995) is currently out of print, but can be downloaded for free, in Acrobat format, from Joop Hox's web page

Kreft and De Leeuw (1998)  [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )].

Bryk and Raudenbush (1992) [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )]

Goldstein (1995) [ amazon.co.uk ] [ amazon.com ] [ publisher (Arnold )]

Longford (1993) [ amazon.co.uk ] [ amazon.com

Loehlin (2004) [ amazon.co.uk ] amazon.com ] [publisher (Erlbaum )]

Schumacker and Lomax (1996) [ amazon.co.uk ] [ amazon.com ] [publisher (Erlbaum )]

Hayduk (1988) [ amazon.co.uk ] [ amazon.com ] [publisher (Johns Hopkins University Press )]

Hoyle (Ed, 1995) [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )]

Kaplan (2000).  [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )]
 

Bollen (1989) - [ amazon.co.uk ] [ amazon.com ] [publisher (Wiley )].

Long (1983a) [ amazon.co.uk ] [ amazon.com ] [publisher (Sage )]

Long (1983b) [ amazon.co.uk ] [ amazon.com ] [publisher (Sage )]

Bollen and Long (Eds.; 1993) [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )]

Jaccard and Wan (1996) [ amazon.co.uk ] [ amazon.com ] [ publisher (Sage )]
 
 
 
 
 

 

Contact

 Got a comment on this web site?  Contact
  webmaster@jeremymiles.co.uk 
 Got a comment on the book?  Contact
 jeremy@jeremymiles.co.uk


FREE HIT COUNTER