The Nature of Statistical Learning Theory (Statistics for Engineering and Information Science)

Rating:
Summary: worth reading
Review: A good, albeit highly idiosyncratic, guide to Statistical Learning. The highly personal account of the theory is both the strong point and the drawback of the treatise. On one side, Vapnick never loses sight of the big picture, and gives illuminating insights and formulations of the "basic problems" (as he calls them), that are not found in any other book. The lack of proofs and the slightly erratic organization of the topic make for a brisk, enjoyable reading. On the minus side, the choice of the topics is very biased. In this respect, the book is a self-congratulatory tribute by the author to himself: it appears that the foundations of statistical learning were single-handedly laid by him and his collaborators. This is not really the case. Consistency of the Empircal Risk Measure is rather trivial from the viewpoint of a personal trained in asymptotic statistics, and interval estimators for finite data sets are the subject of much advanced statistical literature. Finally, SVMs and neural nets are just a part of the story, and probably not the most interesting.
In a nutshell, what Vapnick shows, he shows very well, and is able to provide the "why" of things as no one else. What he doesn't show... you'll have to find somewhere else (the recent Book of Friedman Hastie & Tibs is an excellent starting point).
A last remark. The book is rich in grammatical errors and typos. They could have been corrected in the second edition, but do not detract from the book's readability.

Rating:
Summary: A very nice book to get ideas on support vector machines
Review: This is a very readable book by an authority on this subject. The book starts with the statistical learning theory, pioneered by the author and co-worker's work, and gradually leads to the path of discovery of support vector machines. An excellent and distinctive property of support vector machines is that they are robust to small data perturbation and have good generalization ability with function complexity being controlled by VC dimension. The treatment of nonlinear kernel classification and regression is given for the first time in the first edition. The 2nd edition includes significant updates including a separate chapter on support vector regression as well as a section on logistic regression using the support vector approach. Most computations involved in this book can be implemented using a quadratic programming package. The connections of support vector machines to traditional statistical modeling such as kernel density and regression and model selection are also discussed. Thus, this book will be an excellent starting point for learning support vector machines.

Rating:
Summary: A very nice book to get ideas on support vector machines
Review: This is a very readable book by an authority on this subject. The book starts with the statistical learning theory, pioneered by the author and co-worker's work, and gradually leads to the path of discovery of support vector machines. An excellent and distinctive property of support vector machines is that they are robust to small data perturbation and have good generalization ability with function complexity being controlled by VC dimension. The treatment of nonlinear kernel classification and regression is given for the first time in the first edition. The 2nd edition includes significant updates including a separate chapter on support vector regression as well as a section on logistic regression using the support vector approach. Most computations involved in this book can be implemented using a quadratic programming package. The connections of support vector machines to traditional statistical modeling such as kernel density and regression and model selection are also discussed. Thus, this book will be an excellent starting point for learning support vector machines.

Rating:
Summary: A research field described by the man who invented it
Review: Vapnik and collaborators have developed the field of statistical learning theory underlying recent advances in machine learning and artificial intelligence (e.g. support vector machines). This book almost accomplishes the formidable task of comprehensibly describing the essential ideas of learning theory to non-statisticians. It contains ample theorems but almost no proofs.