B0990
Title: Penalized regression splines in mixture density networks
Authors: Quentin Edward Seifert - Georg-August-Universitaet Goettingen (Germany) [presenting]
Anton Thielmann - TU-Clausthal (Germany)
Elisabeth Bergherr - Georg-August-Univerität Göttingen (Germany)
Benjamin Saefken - Clausthal University of Technology (Germany)
Tobias Hepp - University of Erlangen-Nuremberg (Germany)
Abstract: Mixture density networks (MDN) belong to a class of models that can be applied to data which cannot be sufficiently described by a single distribution since it originates from different components of the main unit and therefore needs to be described by a mixture of densities. In some situations, however, MDNs seem to have problems with the proper identification of the latent components. While these identification issues can to some extent be contained by using custom initialisation strategies for the network weights, this solution is still less than ideal since it involves subjective opinions. It is therefore suggested to replace the hidden layers between the model input and the output parameter vector of MDNs and to estimate the respective distributional parameters with penalised cubic regression splines. Applying this approach to data from Gaussian mixture distributions as well as gamma mixture distributions proved to be successful with the identification issues not playing a role anymore and the splines reliably converging to the true parameter values.
