Part of Advances in Neural Information Processing Systems 8 (NIPS 1995)
Jeffrey Jackson, Mark Craven
We introduce a new algorithm designed to learn sparse percep(cid:173) trons over input representations which include high-order features. Our algorithm, which is based on a hypothesis-boosting method, is able to PAC-learn a relatively natural class of target concepts. Moreover, the algorithm appears to work well in practice: on a set of three problem domains, the algorithm produces classifiers that utilize small numbers of features yet exhibit good generalization performance. Perhaps most importantly, our algorithm generates concept descriptions that are easy for humans to understand.
1