Automatically assigned DDC number:

Manually assigned DDC number: 006312

Number of references: 0

Title: A Maximum Entropy Approach For Optimal Statistical Classification

Author:

Author:

Author:

Author:

Subject: David Miller,Ajit Rao,Kenneth Rose,Allen Gersho A Maximum Entropy Approach For Optimal Statistical Classification

Description: A global optimization technique is introduced for statistical classifier design to minimize the probability of classification error. The method, which is based on ideas from information theory and analogies to statistical physics, is inherently probabilistic. During the design phase, data are assigned to classes in probability, with the probability distributions chosen to maximize entropy subject to a constraint on the expected classification error. This entropy maximization problem is seen to be equivalent to a free energy minimization, motivating a deterministic annealing approach to minimize the misclassification cost. Our method is applicable to a variety of classifier structures, including nearest prototype, radial basis function, and multilayer perceptron-based classifiers. On standard benchmark examples, the method applied to nearest prototype classifier design achieves performance improvements over both the learning vector quantizer, as well as over multilayer perceptron classi...

Contributor: The Pennsylvania State University CiteSeer Archives

Publisher: unknown

Date: 1995-12-10

Pubyear: unknown

Format: ps

Identifier: http://citeseer.ist.psu.edu/140606.html

Source: http://scl.ece.ucsb.edu/current/ajit/papers/nnsp95.ps

Language: en

Rights: unrestricted