r-statistics.co by Selva Prabhakaran


Advanced Regression Models

Each of the regression analysis below contains working code examples with brief use-case explanations covered for each of the regression types in the list below. Many of these code snippets are generic enough so you could use them as a base template to start and build up on for your analyses.

Please note that the information presented in these pages should not be construed as full and complete analysis, but rather as a template and a hand guide of available modeling options. You are advised to pursue independent and thorough research before arriving at conclusions.

METHOD APPLICATION CASE
Robust Regression Applicable in all cases where OLS regression can be used. Applies re-weighting to reduce outlier influence.
Logistic Regression Models binary variables.
Probit Regression Models binary variables.
Multinomial Regression Models categorical variables with more that 2 levels.
Ordinal Logistic Models ordinal or rank variables.
Poisson and Negative Binomial Models count variables. Neg Binomial is used when there is over-dispersion.
Ridge Regression Address Multicollinearity
Beta Regression Models variables within (0, 1) range.
Dirichlet Regression Models compositional data
Loess Regression Smoothing Time series.
Isotonic Regression For approximation of data that can only increase (..typically cumulative data)