
De Vries, J.P., Hooge, I.T.C., Wiering, M.A. & Verstraten, F.A.J. (2011). How Longer Saccade Latencies Lead to a Competition for Salience. Psychological Science, 22(7), 916-923. De Vries, J.P., Hooge, I.T.C., Wiering, M.A. & Verstraten, F.A.J. (2011). Saccadic selection and crowding in visual search: stronger lateral masking leads to shorter search times. Experimental Brain Research, 211(1), 119-131. Drugan, M.M. & Wiering, M.A. (2010). Feature selection for Bayesian network classifiers using the MDL-FS score. International Journal of Approximate Reasoning, 51(6), 695-717. Seijen, H., Hasselt, H.P. van, Whiteson, S. & Wiering, M.A. (2009). A Theoretical and Empirical Analysis of Expected Sarsa. In Proceedings of the IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADRPL 2009) (pp. 177-184). IEEE Press. bin Abdullah, A., Veltkamp, R.C. & Wiering, M.A. (2009). An Ensemble of Deep Support Vector Machine for Image Categorization. In Proceedings of the International Conference on Soft Computing and Pattern Recognition (SoCPaR'09) (pp. 301-306). De Vries, J.P., Hooge, I.T.C., Wiering, M.A. & Verstraten, F.A.J. (2009). Coarse-to-fine encoding of targets in the visual periphery. In Proceedings of the 12th meeting of the Dutch Psychonomic Society (pp. 42). bin Abdullah, A., Veltkamp, R.C. & Wiering, M.A. (2009). Fixed Partitioning and Salient Point with MPEG-7 Cluster Correlograms for Image Categorization. onbekend: UU BETA ICS Departement Informatica. bin Abdullah, A., Veltkamp, R.C. & Wiering, M.A. (2009). Fixed Partitioning and Salient Points with MPEG-7 Cluster. Pattern Recognition. bin Abdullah, A., Veltkamp, R.C. & Wiering, M.A. (2009). Spatial Pyramids and Two-layer Stacking SVM classifiers for Image. In Proceedings of the International Joint Conference on Neural. Wiering, M.A. & Hasselt, H.P. van (2009). The QV Family Compared to Other Reinforcement Learning Algorithms. In Proceedings of the IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL 2009) (pp. 101-108). IEEE Press. Hasselt, H.P. van & Wiering, M.A. (2009). Using Continuous Action Spaces to Solve Discrete Problems. In Proceedings of the 2009 International Joint Conference on Neural Networks (IJCNN 2009) (pp. 1149-1156). Atlanta, GA: IEEE Press. Otterlo, M. van, Wiering, M.A., Dastani, M.M. & Meyer, J-J.Ch. (2008). A Characterization of Sapient Agents. In R.V. Mayorga & L. Perlovsky (Eds.), Toward Artificial Sapience, Principles and Methods for Wise Systems (pp. 129-141). Berlin: Springer. Pape, L., Gruijl, J. de & Wiering, M.A. (2008). Democratic Liquid State Machines for Music Recognition. In Prasad, Bhanu; Prasanna, S.R.M. (Ed.), Speech, Audio, Image and Biomedical Signal Processing using Neural Networks (Studies in Computational Intelligence, 83). Berlin / Heidelberg: Springer. Wiering, M.A. & Hasselt, H.P. van (2008). Ensemble Algorithms in Reinforcement Learning. IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics, 38(4), 930-936. Otterlo, M. van, Wiering, M.A., Dastani, M.M. & Meyer, J-J.Ch. (2007). A Characterization of Sapient Agents. In Toward Artificial Sapience: Principles and Methods for Wise Systems. Springer. bin Abdullah, A. & Wiering, M.A. (2007). CIREC : Cluster Correlogram Image Retrieval and Categorization using MPEG-7 Descriptors. In In Proc. of the IEEE Synposium on Computational Intelligence in Image and Signal Processing (CIISP2007) (pp. 431-437). Wiering, M.A. & Jong, E.D. de (2007). Computing Optimal Stationary Policies for Multi-objective Markov Decision Processes. In Proceedings of the IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL) (pp. 158-165). Hasselt, H.P. van & Wiering, M.A. (2007). Convergence of Model-Based Temporal Difference Learning for Control. In Proceedings of the IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL) (pp. 60-67). Pape, L., Ruessink, B.G., Wiering, M.A. & Turner, I.L. (2007). Recurrent neural network modeling of nearshore sandbar behavior. Neural Networks, 20(4), 509-518. Hasselt, H.P. van & Wiering, M.A. (2007). Reinforcement Learning in Continuous Action Spaces. In Proceedings of the IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL) (pp. 272-279). Lefakis, L. & Wiering, M.A. (2007). Semi-Supervised Methods for Handwritten Character Recognition using Active Learning. In M.M. Dastani & E.D. de Jong (Eds.), Proceedings of the 19th Belgian-Netherlands Conference on Artificial Intelligence (pp. 205-212). Wiering, M.A. & Hasselt, H.P. van (2007). Two Novel On-policy Reinforcement Learning Algorithms based on TD(lambda)-methods. In Proceedings of the IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL) (pp. 280-287). Zwanepol Klinkmeijer, L., Jong, E.D. de & Wiering, M.A. (2006). A Serial Population Genetic Algorithm for Dynamic Optimization Problems. In Y. Saeys, E. Tsiporkova, B..De Baets & Y..Van de Peer (Eds.), Proceedings of the 15th Belgian-Dutch Conference on Machine Learning (pp. 41-48). Zant, T. van der, Schomaker, L., Wiering, M.A. & Brink, A. van den (2007). Cognitive Developmental Pattern Recognition: Learning to Learn. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (pp. 1208-1213). Gruijl, J.R. de & Wiering, M.A. (2006). Musical Instrument Classification using Democratic Liquid State Machines. In Y. Saeys, E. Tsiporkova, B..De Baets & Y..Van de Peer (Eds.), Proceedings of the 15th Belgian-Dutch Conference on Machine Learning (pp. 33-40). Pape, L., Ruessink, B.G., Wiering, M.A. & Turner, I.L. (2006). Neural network modeling of nearshore sandbar behavior. In Proceedings of the 2006 International Joint Conference on Neural Networks (pp. 8735-8742). Vancouver, Canada. Back, W., Jong, E.D. de & Wiering, M.A. (2006). Red Queen dynamics in a predator-prey ecosystem. In Proceedings of the Genetic and Evolutionary Computation Conference, GECCO-06 (pp. 381-382). Diggelen, J. van, Wiering, M.A. & Jong, E.D. de (2006). Strategies for ontology negotiation: Finding the right level of generality. In F. Dignum & R.M. van Eijk (Eds.), In Agent Communication II Vol. 3859. Lecture Notes in Artificial Intelligence (pp. 164-180). Springer Verlag. Otterlo, M. van, Wiering, M.A., Dastani, M.M. & Meyer, J-J.Ch. (2005). A Characterization of Sapient Agents. In R.V. Mayorga & L.I. Perlovsky (Eds.), Proceedings 2005 IEEE International Conference on Integration of Knowledge Intensive Multi-Agent Systems (KIMAS'05). Kuilenburg, H. van, Wiering, M.A. & Uyl, M. den (2005). A Model Based Method for Automatic Facial Expression Recognition. In J. Gama. (Ed.), Proceedings of the 16th European Conference on Machine Learning (ECML'05) (pp. 194-205). Springer-Verlag Berlin Heidelberg. Sindlar, M. & Wiering, M.A. (2005). A Modular Approach to Facial Expression Recognition. In M. van Otterlo, M. Poel & A. Nijholt (Eds.), Proceedings of the 14th Belgian-Dutch Conference on Machine Learning (pp. 81-88). Wiering, M.A. (2005). Comparing Training Paradigms for Learning to Play Backgammon. In D. Leone (Ed.), Proceedings of the 7th European Workshop on Reinforcement Learning (pp. 29-30). Wiering, M.A., Mignogna, F. & Maassen, B. (2005). Evolving Neural Networks for Forest Fire Control. In M. van Otterlo, M. Poel & A. Nijholt (Eds.), Proceedings of the 14th Belgian-Dutch Conference on Machine Learning (pp. 113-120). Wiering, M.A., Patist, J.P. & Mannen, H. (2005). Learning to PLay Board Games using Temporal Difference Methods. (UU-CS2005-048 ). onbekend: UU WINFI Informatica en Informatiekunde. Negenborn, R.R., Schutter, B. de, Wiering, M.A. & Hellendoorn, H. (2005). Learning-based model predictive control for Markov decision processes. In Proceedings of the 16th IFAC World Congress. Zant, T. van der, Wiering, M.A. & Eijck, J. van (2005). On-line robot learning using the interval estimation algorithm. In D. Leone (Ed.), Proceedings of the 7th European Workshop on Reinforcement Learning (pp. 11-12). Wiering, M.A. (2005). QV(lambda)-learning: A New On-policy Reinforcement Learning Algrithm. In D. Leone (Ed.), Proceedings of the 7th European Workshop on Reinforcement Learning (pp. 17-18). Maas, S., Wiering, M.A. & Verhaar, B. (2005). Reinforcement Learning of a Pneumatic Robot Arm Controller. In D. Leone (Ed.), Proceedings of the 7th European Workshop on Reinforcement Learning (pp. 23-24). Wiering, M.A., Leijnen, S., Koster, A., Weers, S. van & Back, W. (2004). Autonomous Intelligent Robots at Utrecht University. International Journal of Advanced Robotic Systems, 1(2), 125-128. Wiering, M.A. (2004). Convergence and Divergence in Standard and Averaging Reinforcement Learning. In F..Giannot J-F. Boulicaut & D. Pedreschi (Eds.), Proceedings of the 15th European Conference on Machine Learning (ECML'04) (pp. 477-488). Springer-Verlag Heidelberg Berlin. Negenborn, R.R., Schutter, B. de, Wiering, M.A. & Hellendoorn, J. (2004). Experience-based model predictive control using reinforcement learning. In Proceedings of the 8th Trail Congress 2004 - A World of Transport, Infrastructure and Logistics (CD-ROM).. Wiering, M.A., Veenen, J., Vreeken, J. & Koopman, A. (2004). Intelligent Traffic Light Control. (UU-CS2004-029 ). Utrecht: Utrecht University: Information and Computing Sciences. Mannen, H. & Wiering, M.A. (2004). Learning to Play Chess using TD(lambda)-learning with database games. In . A. Nowe & K. Steenhout (Eds.), Benelearn'04: Proceedings of the Thirteenth Belgian-Dutch Conference on Machine Learning (pp. 72-79). Patist, J-P. & Wiering, M.A. (2004). Learning to Play Draughts using temporal difference learning with neural networks and databases. In . A. Nowe & K. Steenhout (Eds.), Benelearn'04: Proceedings of the Thirteenth Belgian-Dutch Conference on Machine Learning (pp. 87-94). Wiering, M.A. (2004). Memory-Based Memetic Algorithms. In . A. Nowe & K. Steenhout (Eds.), Benelearn'04: Proceedings of the Thirteenth Belgian-Dutch Conference on Machine Learning (pp. 191-198). Wiering, M.A., Vreeken, J., Veenen, J. & Koopman, A. (2004). Simulation and Optimization of Traffic in a City. In IEEE Intelligent Vehicles Symposium (IV '04). Wierstra, D. & Wiering, M.A. (2004). Utile Distinction Hidden Markov Models. In Proceedings of the Twenty-first International Conference on Machine Learning (ICML'04) (pp. 855-862). ACM Press. Otterlo, M. van, Wiering, M.A., Dastani, M.M. & Meyer, J-J.Ch. (2003). A Characterization of Sapient Agents. In H. Hexmoor (Ed.), Proceedings of the International Conference on Integration of Knowledge Intensive Multi-Agent Systems (KIMAS'03): Modeling, Exploration, and Engineering (pp. 172-177). Boston, Massachusetts: IEEE Press, Boston, MA. Wiering, M.A. (2003). Hierarchical Mixtures of Naive Bayesian Classifiers. In P. Larranaga, J. Lozano, J. Pena & I. Inza (Eds.), European COnference on Machine Learning. Workshop on Probabilistic Graphical Models for Classification. ERCIM news (pp. 93-104). Wiering, M.A. (2003). Intelligent Traffic Light Control. ERCIM news, 53, 40-41. Wiering, M.A. & Mignogna, F. (2003). Learning to Control Forest Fires with ESP. In A. Dutech & O. Buffet (Eds.), Proceedings of the Sixth European Workshop on Reinforcement Learning ERCIM news (pp. 22-23). Jong, E.D. de, Wiering, M.A. & Drugan, M.M. (2003). Post-Processing for MCMC. (UU-CS2003-021 ). Utrecht: Utrecht University: Information and Computing Sciences. Wiering, M.A. (2002). Evolving Causal Neural Networks. In M.A. Wiering (Ed.), Benelearn'02: Proceedings of the Twelfth Belgian-Dutch Conference on Machine Learning (pp. 103-108). Reynolds, S. & Wiering, M.A. (2002). Fast Q(lambda) revisited. (TR-CSRP02-2 ). Birmingham, England: University of Birmingham, School of Computer Science. Wiering, M.A. (2002). Hierarchical Mixtures of Naive Bayesian Classifiers. In H. Blockeel & M. Denecker (Eds.), BNAIC'02: Proceedings of the Thirteenth Belgium-Netherlands Conference on Artificial Intelligence (pp. 363-370). Wiering, M.A. (2002). Hierarchical mixtures of naive Bayes classifiers. (UU-CS2002-003 ). Utrecht, The Netherlands: Utrecht University: Information and Computing Sciences. Wiering, M.A. (2002). Model-based reinforcement learning in dynamic environments. (UU-CS2002-029 ). Utrecht, The Netherlands: Utrecht University: Information and Computing Sciences. Wiering, M.A. (2002). Proceedings of the 12th Belgian-Dutch Conference on Machine Learning. (UU-CS2002-046 ). Utrecht, The Netherlands: Utrecht University: Information and Computing Sciences. Wiering, M.A., Salustowicz, R.P. & Schmidhuber, J. (2001). Model-Based Reinforcement Learning for Evolving Soccer Strategies. In N. Baba & L. Jain (Eds.), Computational Intelligence in Games, chapter 5. Lugano, Zwitserland. Jong, J. de & Wiering, M.A. (2001). Multiple Ant Colony Systems for the Busstop Allocation Problem. In Proceedings of the Thirteenth Belgium-Netherlands Conference on Artificial Intelligence (pp. 141-148). Wiering, M.A. (2001). Reinforcement Learning in Dynamic Environments using Instantiated Information. In Machine Learning: Proceedings of the Eighteenth International Conference (ICML2001) (pp. 585-592). Wiering, M.A. (2000). Multi-Agent Reinforcement Learning for Traffic Light control. In Machine Learning: Proceedings of the Seventeenth International Conference (ICML'2000) (pp. 1151-1158). Tusscher, K.H.W.J. ten, Hagen, S. ten & Wiering, M.A. (2000). The influence of communication on the choice to behave cooperatively. In A. Feelders (Ed.), Proceedings of the Tenth Belgian-Dutch Conference on Machine Learning (pp. 39-46).