Optimal Decision Making Models in Changing Environments
| dc.contributor.advisor | Josić, Krešimir | |
| dc.contributor.committeeMember | Kilpatrick, Zachary P. | |
| dc.contributor.committeeMember | Ott, William | |
| dc.contributor.committeeMember | Török, Andrew | |
| dc.creator | Radillo, Adrian Ernesto 1986- | |
| dc.creator.orcid | 0000-0002-8890-6514 | |
| dc.date.accessioned | 2019-05-23T14:35:48Z | |
| dc.date.created | August 2018 | |
| dc.date.issued | 2018-08 | |
| dc.date.submitted | August 2018 | |
| dc.date.updated | 2019-05-23T14:35:48Z | |
| dc.description.abstract | Mathematical decision making theory has been successfully applied to the neuroscience of sensation, behavior, and cognition, for more than fifty years. Classical models rely on the assumption that the environment doesn't change during the period of observation. This assumption has been relaxed in more recent studies of adaptive decision making. We develop new ideal observer -- Bayes-optimal -- models for this latter setting; and more specifically for the case in which temporal integration of noisy evidence improves choice accuracy. The generative model of the stimulus is a Hidden Markov Model that the ideal observer must filter, and more generally learn. In a first part, we derive and study models tailored to pulsatile evidence with Poisson-distributed timing. We characterize the model parameters that determine choice accuracy, and compare the ideal observer to a finely tuned linear-leak model. We show that the linear model is both more sensitive to parameter perturbation and easier to fit to choice data. In a second part, we derive Bayes-optimal models that learn the change rates of their environment. We do so in several configurations: in discrete time, in continuous time, when more than one change rate must be learned, and for both pulsatile and continuously arriving, drift-diffusion type evidence. We find that such learning models may outperform wrongly tuned known-hazard rate models, but are hard to implement computationally. We conclude that the mathematical study of optimal decision making is crucial for at least three reasons. First, it helps develop an intuition about the various computations required to perform a task. Second, Bayes-optimal models allow benchmarking accuracy and other dependent variables from experiments. Finally, from them, approximate schemes may be built, hopefully taking us one step closer to understanding the human brain. | |
| dc.description.department | Mathematics, Department of | |
| dc.format.digitalOrigin | born digital | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.uri | https://hdl.handle.net/10657/4001 | |
| dc.language.iso | eng | |
| dc.rights | The author of this work is the copyright owner. UH Libraries and the Texas Digital Library have their permission to store and provide access to this work. Further transmission, reproduction, or presentation of this work is prohibited except with permission of the author(s). | |
| dc.subject | Decision-making | |
| dc.subject | Hidden Markov model | |
| dc.subject | Ideal observer | |
| dc.subject | Bayesian inference | |
| dc.subject | Sensory neuroscience | |
| dc.subject | Filtering | |
| dc.title | Optimal Decision Making Models in Changing Environments | |
| dc.type.dcmi | Text | |
| dc.type.genre | Thesis | |
| local.embargo.lift | 2020-08-01 | |
| local.embargo.terms | 2020-08-01 | |
| thesis.degree.college | College of Natural Sciences and Mathematics | |
| thesis.degree.department | Mathematics, Department of | |
| thesis.degree.discipline | Mathematics | |
| thesis.degree.grantor | University of Houston | |
| thesis.degree.level | Doctoral | |
| thesis.degree.name | Doctor of Philosophy |