get_prep_info_class_gmm — Compute the information content of the preprocessed feature vectors
of a GMM.
get_prep_info_class_gmm( : : GMMHandle, Preprocessing : InformationCont, CumInformationCont)
get_prep_info_class_gmm computes the information content of
the training vectors that have been transformed with the
preprocessing given by Preprocessing.
Preprocessing can be set to 'principal_components'
or 'canonical_variates'. The preprocessing methods are
described with create_class_mlp. The information content is
derived from the variations of the transformed components of the
feature vector, i.e., it is computed solely based on the training
data, independent of any error rate on the training data. The
information content is computed for all relevant components of the
transformed feature vectors (NumComponents for
'principal_components' and 'canonical_variates',
see create_class_gmm), and is returned in
InformationCont as a number between 0 and 1. To convert
the information content into a percentage, it simply needs to be
multiplied by 100. The cumulative information content of the first
n components is returned in the n-th component of
CumInformationCont, i.e., CumInformationCont
contains the sums of the first n elements of
InformationCont. To use get_prep_info_class_gmm, a
sufficient number of samples must be added to the GMM given by
GMMHandle by using add_sample_class_gmm or
read_samples_class_gmm.
InformationCont and CumInformationCont can be used
to decide how many components of the transformed feature vectors
contain relevant information. An often used criterion is to require
that the transformed data must represent x% (e.g., 90%) of the
data. This can be decided easily from the first value of
CumInformationCont that lies above x%. The number thus
obtained can be used as the value for NumComponents in a
new call to create_class_gmm. The call to
get_prep_info_class_gmm already requires the creation of a
GMM, and hence the setting of NumComponents in
create_class_gmm to an initial value. However, if
get_prep_info_class_gmm is called, it is typically not known
how many components are relevant, and hence how to set
NumComponents in this call. Therefore, the following
two-step approach should typically be used to select
NumComponents: In a first step, a GMM with the maximum
number for NumComponents is created
(NumComponents for 'principal_components' and
'canonical_variates'). Then, the training samples are
added to the GMM and are saved in a file using
write_samples_class_gmm. Subsequently,
get_prep_info_class_gmm is used to determine the information
content of the components, and with this NumComponents.
After this, a new GMM with the desired number of components is
created, and the training samples are read with
read_samples_class_gmm. Finally, the GMM is trained with
train_class_gmm.
GMMHandle (input_control) class_gmm → (handle)
GMM handle.
Preprocessing (input_control) string → (string)
Type of preprocessing used to transform the feature vectors.
Default value: 'principal_components'
List of values: 'canonical_variates', 'principal_components'
InformationCont (output_control) real-array → (real)
Relative information content of the transformed feature vectors.
CumInformationCont (output_control) real-array → (real)
Cumulative information content of the transformed feature vectors.
* Create the initial GMM
create_class_gmm (NumDim, NumClasses, NumCenters, 'full',\
'principal_components', NumComponents, 42, GMMHandle)
* Generate and add the training data
for J := 0 to NumData-1 by 1
* Generate training features and classes
* Data = [...]
* ClassID = [...]
add_sample_class_gmm (GMMHandle, Data, ClassID, Randomize)
endfor
write_samples_class_gmm (GMMHandle, 'samples.gtf')
* Compute the information content of the transformed features
get_prep_info_class_gmm (GMMHandle, 'principal_components',\
InformationCont, CumInformationCont)
* Determine Comp by inspecting InformationCont and CumInformationCont
* NumComponents = [...]
* Create the actual GMM
create_class_gmm (NumDim, NumClasses, NumCenters, 'full',\
'principal_components', NumComponents, 42, GMMHandle)
* Train the GMM
read_samples_class_gmm (GMMHandle, 'samples.gtf')
train_class_gmm (GMMHandle, 200, 0.0001, 0.0001, Regularize, Centers, Iter)
write_class_gmm (GMMHandle, 'classifier.gmm')
If the parameters are valid, the operator
get_prep_info_class_gmm returns the value TRUE. If
necessary an exception is raised.
get_prep_info_class_gmm may return the error 9211 (Matrix is
not positive definite) if Preprocessing =
'canonical_variates' is used. This typically indicates
that not enough training samples have been stored for each class.
add_sample_class_gmm,
read_samples_class_gmm
clear_class_gmm,
create_class_gmm
Christopher M. Bishop: “Neural Networks for Pattern Recognition”;
Oxford University Press, Oxford; 1995.
Andrew Webb: “Statistical Pattern Recognition”; Arnold, London;
1999.
Foundation