• If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

  • Buried in cloud files? We can help with Spring cleaning!

    Whether you use Dropbox, Drive, G-Suite, OneDrive, Gmail, Slack, Notion, or all of the above, Dokkio will organize your files for you. Try Dokkio (from the makers of PBworks) for free today.

  • Dokkio (from the makers of PBworks) was #2 on Product Hunt! Check out what people are saying by clicking here.



Page history last edited by mike@mbowles.com 10 years ago

Lecture: Tibshirani's notes from Chapter 4 and Chapter 4 of the text

Homework: Homework03.pdf


     Here's the code for the Wed class:  ZipCode.R

     Code for IRLS two-class logistic regression LogisticRegression.R

     Examples using glmnet including South African Heart Study used in ESL and digits 1-4 of the zip code data glmnetExamples.R


Example Data:

     Graphical and text output for in-class example:



     text files corresponding to the two plots above:




To review matrix derivatives, check out page 8 of Stanford Professor Andrew Ng's notes:




Here's a link to paper by Friedman, Hastie, Tibshirani paper Regularization Paths for Generalized Linear Models via Coordinate Descent,  (Journal of Statistical Software, Feb 2010).  This paper describes the algorithm used in the glmnet R-package.  http://www.jstatsoft.org/v33/i01/



Here's the plot cv output from glmnet classifying characters 1-4 from the handwritten zip code data set.  damn glmnet is fast!

Recorded Lecture 3:

Part 1: https://datamining.webex.com/datamining/ldr.php?AT=pb&SP=MC&rID=107355092&rKey=c4366fcaae331ce6


Part 2: https://datamining.webex.com/datamining/ldr.php?AT=pb&SP=MC&rID=107355102&rKey=f738a3c6741624b7


Part 3:  https://datamining.webex.com/datamining/ldr.php?AT=pb&SP=MC&rID=107355112&rKey=0a11055c91cd0439



Comments (0)

You don't have permission to comment on this page.