Supplemental Readings for Machine Learning

General

• T. Hastie, R. Tibshirani and J. Friedman (2009). The Elements of Statistical Learning Springer.
• C. Bishop (2006). Pattern Recognition and Machine Learning. Springer.
• I. Witten and E. Frank (2005). Data Mining: Practical Machine Learning Tools and Techniques (Second Edition). Morgan Kaufmann.
• T. Dietterich, "Machine Learning Research: Four Current Directions," AI Magazine, 18(4):97-136, Winter 1997.
• T. Mitchell, Machine Learning, McGraw-Hill, 1997.
• G. Piatetsky-Shapiro, C. Djeraba, L. Getoor, R. Grossman, R. Feldman, and M. Zaki, "What Are The Grand Challenges for Data Mining? KDD-2006 Panel Report," SIGKDD Explorations, 8(2):70-77, 2006.

Evaluation

• T. Fawcett, "ROC Graphs: Notes and Practical Considerations for Researchers," HP Labs Technical Report HPL-2003-4, 2004.
• F. Provost, T. Fawcett, and R. Kohavi,"The Case Against Accuracy Estimation for Comparing Classifiers," Proceedings of the Fifteenth International Conference on Machine Learning (ICML), 1998.

Kernel Methods

• K. Bennett and C. Campbell, "Support Vector Machines: Hype or Hallelujah?," SIGKDD Explorations, 2(2):1-13, December 2000.
• C. J. C. Burges, "A Tutorial on Support Vector Machines for Pattern Recognition," Data Mining and Knowledge Discovery, 2(2):121-167, 1998.
• K. Muller, S. Mika, G. Ratsch, K. Tsuda, and B. Scholkopf, "An Introduction to Kernel-based Learning Algorithms," IEEE Neural Networks, 12(2):181-201, May 2001.

  Online Tutorials

  • Tutorials available at www.support-vector.net.
  • Tutorials available at www.kernel-machines.org
  • Tutorial by Andrew Moore of CMU

Ensemble Methods

• T. Dietterich (2000). Ensemble Methods in Machine Learning. In J. Kittler and F. Roli (Ed.) First International Workshop on Multiple Classifier Systems, Lecture Notes in Computer Science (pp. 1-15). New York: Springer Verlag.

Graph-based Learning

• D. Cook and L. Holder, "Graph-based Data Mining," IEEE Intelligent Systems, 15(2):32-41, March/April 2000.

ML in Games

• S. Gelly and D. Silver, "Combining Online and Offline Knowledge in UCT," International Conference on Machine Learning, 2007. (Go)
• J. Schaeffer, R. Lake, P. Lu, and M. Bryant, "CHINOOK: The World Man-Machine Checkers Champion," AI Magazine, Spring 1996.
• J. Schaeffer, N. Burch, Y. Bjornsson, A. Kishimoto, M. Muller, R. Lake, P. Lu, S. Sutphen, "Checkers Is Solved," Science Magazine, July 2007.