| 18 Nov 2005 |
Phillip Boyle |
Bayesian Model Comparison - Calculating the Evidence |
Overview on the use of probabilistic evidence to select between alternate models or hypotheses. On paper this is clear cut, but the hard part is computing the evidence, which amounts to numerical integration. I'll look a annealed importance sampling, which is a method that can do this without having to free up 75 years of computer time. |
| 4 Nov 2005 |
Will Smart |
Empirical Schema Theory Validation by Finding Common Program Substructures |
The topic will be some things I have been doing for my PhD, dealing with repeated code in Genetic Programming (GP). I have been empirically finding common "fragments" of programs, and the talk will be on: * Some previous related material, including schema theory in GAs, GP; * What are fragments in GP programs? * How do we find fragments? * Some things we can do with fragments. Time permitting, I will be describing the problem domain I have recently been using: Object Trackers/Detectors/Classifiers. |
| 28 Oct 2005 |
Maciej Wojnar |
The Flight of Icarus |
Earlier this year, I had several important ideas about agents that act in interesting worlds. In this talk, I'm going to talk about Icarus, a system from 5 years ago that stole my ideas and messed them up. I'll talk about the challenges of creating an agent that can act intelligently, the problems that planning and reacting agents have, and teleoreactive agents that try to avoid these problems by integrating planning and reacting. I'll then describe Icarus, an implementation of a teleoreactive agent, and discuss its limitations and the extensions it requires. |
| 28 Oct 2005 |
Mike Paulin (Otago) |
The Neural Particle Filter: A model of neural computations for dynamical state estimation in the brain |
Recent experimental work in collaboration with Larry Hoffman at UCLA has shown that, as a consequence of fractional order dynamical characteristics of vestibular sensory transduction mechanisms, single spikes generated by vestibular motion-sensing neurons can be regarded as measurements of the dynamical state of the head. We hypothesize that this measurement is translated into an explicit Monte Carlo representation in the brainstem vestibular nucleus, which forms a central map of head state. In this representation, neural spikes are regarded as particles and their spatial distribution over the map at any instant represents the brain's knowledge of head state. Particles are constrained to move along axons, corresponding to pre-defined state trajectories. A network can be constructed so that the distribution of spikes in the map approximates the Bayesian posterior distribution of states given the sense data. The neural particle filter model generates the circuit topology and response properties of real neurons in the brain, from purely statistical principles. See Mike's recent paper for the details. |
| 21 Oct 2005 |
Daniel Crabtree |
A new approach to sandwiches. |
My report on the WI/IAT 2005 international conference. This talk is going to be a summary and overview of interesting ideas, projects, and papers that I can remember about from at the conference. Additional ideas from people that I talked to are likely to be included. This talk is likely to be exceptionally light on technical details - very much in contrast to most of the actual talks at the conference. BTW: I have chosen to keep the automagically generated title. |
| 14 Oct 2005 |
Zbigniew Michalewicz (Adelaide) |
Open discussion |
This follows Zbyszek's seminar to the School earlier in the day. Prof Michalewicz is one of the big names in the area of evolutionary computing (together with John Holland, David Fogel, John Koza, etc.). He has chaired a large number of international conferences in AI, particularly evolutionary computing. He is the author of over 200 research publications, including some famous books, such as "Genetic algorithms + Data Structures = Evolutionary Programs" and "How to Solve It: Modern Heuristics". |
| 7 Oct 2005 |
Mengjie Zhang |
New kinds of negative social processes (auto-generated). |
I am going to discuss some issues in genetic programing, linked to classification and evolutionary computing. |
| 30 Sep 2005 |
Marcus Frean |
On the optimisation of passive strategies using integration (auto-generated). |
I'm going to attempt to draw an analogy between predictive coding and topographic mappings. Your job will be to decide if this profound insight is (a) entirely spurious, or (b) merely a waste of time. The talk will be a boundary case on the "preparedness" dimension. |
| 23 Sep 2005 |
Phillip Boyle |
100 attempts to find 8 numbers that balance 2 poles |
Introduction to and demonstration of an efficient method to find controllers that balance two poles on a cart. The algorithm infers a fitness surface over controller space and uses that to guide its search. I offer an apology in advance to those with a pathological dislike of MATLAB and the 92% of you who don't want to hear the word "Gaussian" more than once per hour. |
| 16 Sep 2005 |
Russell Tod |
|
Discussion of distributed phase codes. |
| 2 Sep 2005 |
Daniel Crabtree |
Web Clustering - New Scoring and Selection Methods, New Evaluation Method |
I will give: a 20 minute presentation on a new scoring method and a new cluster selection method. a 10 minute presentation on a new evaluation method. These are two talks that I will be giving at the Web Intelligence Conference in a week or so. So these will be practice runs. Please ask questions and help me sort out any problems with these talks. |
| 26 Aug 2005 |
David MacKay (Cambridge) |
Distributed Phase Codes for Associative Memory, Prediction, and Latent Variable Discovery |
A distributed phase code represents objects by the times of neuronal action potentials in a large number of neurons. If the object has instantiation parameters (for example, scale and pose, in the case of visual objects), the timings and probabilities of the action potentials are smoothly-varying functions of those parameters. If multiple objects are present, their associated action potential patterns are simply superposed in the distributed phase code. We present simple learning rules that allow distributed phase codes to instantiate associative memory and prediction. The resulting system can store and recall continuous-valued memories, singly or concurrently. Point attractors, line attractors, and manifold attractors are all learned by the same rules. Similar recursive learning rules take distributed phase codes for elementary objects and produce distributed phase codes for higher-order objects. Short Bio: David MacKay is a Professor in the Department of Physics at Cambridge University. He obtained his PhD in Computation and Neural Systems at the California Institute of Technology. His interests include machine learning, reliable computation with unreliable hardware, the design and decoding of error correcting codes, and the creation of information-efficient human-computer interfaces. |
| 19 Aug 2005 |
Yun Zhang |
Polly |
A soft polynomial network based learning system. |
| 12 Aug 2005 |
Richard Mansfield |
Rock-paper-scissors |
A model for the emergence of intransitive competition in biology |
| 5 Aug 2005 |
Xiaoying Sharon Gao |
learning patterns for information extraction from web pages |
I will briefly introduce the projects I am currently supervising and then talk about some recent research on learning patterns for information extraction from Web pages. |
| 29 Jul 2005 |
Daniel Crabtree |
Web Clustering - A Sneak Peak |
I will give a sneak peak into the content of two papers that I've had accepted at the Web Intelligence conference. The full presentation of these with slides will come in a few weeks. This sneak peak is just to introduce some of the interesting ideas in both papers, so I have a feeling for the type of content to include in my actual presentation. I will follow that with some sort of demonstration of my clustering system. I'm pretty sceptical as to whether a live demonstration of any new searches can be done due to time constraints, but there are a few prepared searches to look through. At the start of the talk we will decide on a 1 word search and try to have it ready to view by the end of the talk, so bring ideas for that. |
| 22 Jul 2005 |
Maciej Wojnar |
Exploiting Structure when Generalizing |
I'm going to talk about a couple of "not fully baked" ideas I've had. I'm most interested in trying to achieve the goal of developing an autonomous, intelligent agent that can act effectively in the human domain. In the talk I'll define what I mean by that and explain why I am pessimistic about current methods leading to this goal. The world is a very structured domain and I believe that any algorithm for generalizing that scales to this domain will need to exploit that structure. To keep the talk grounded and not too fluffy I'll talk about some AI systems that exploit structure: a little program I wrote for solving Rubik's cube (fun to watch) and a less trivial program that can make a cup of coffee efficiently in a complex, relational, partially-observable world (not as fun to watch). I'll talk about SOAR (a system that unfortunately is very similar to my one), chunking, explanation based learning, and why I think they are dodging the real issue. I'll also talk about (if I have time) David Andreae's PhD thesis program that exploits structure to generalize images. The talk is going to be informal. |
| 8 Jul 2005 |
Will Smart |
Science using art created with science |
In GP we use genetic programs, but what do they look like? In this talk I will demonstrate a real-time raytracing renderer for programs that I have made. The output is stunning, who would have known the wacky shapes (in feature space) that GP uses all the time? Aside from looks, the renderer has things to say about the way GP works, such as the role of functions in GP and causes of early convergence. |
| 1 Jul 2005 |
Phillip Boyle |
Linear combinations of random features |
This is a follow up to the talk Marcus gave on the liquid state machine. I'll be looking at the advantages of learning a linear combination of random features, instead of learning the features themselves. (Here, a feature is just a non-linear transformation of input space). Advantages include convexity (no local minima) and analytic solutions (no MCMC or nonliear optimisation required). Disadvantages (damn it) will be flippantly glossed over, and then seriously alluded to, and finally embraced in their entirety. |
| 30 Jun 2005 |
Huayang Xie |
Practice Talk for CEC2006 |
gpGP: good predecessors in Genetic Programming |
| 24 Jun 2005 |
Marcus Frean |
factor graphs, probability propagation, and all that. |
A dry run of a talk I'll be giving next week in Wanaka at the Hidden Markov Models workshop. Here is the draft presentation as a PDF |
| 17 Jun 2005 |
Marcus Frean |
In praise of senseless arbitrary complexity. |
Last week Mukhlis's talk generated an interesting discussion that I propose we continue, because it's a subject that seems to come up over and over again. I'd like to kick things off by defending (apparently) senseless arbitrary complexity. I'll mention Neal's result relating Bayesian NNs to Gaussian processes, then SVMs, followed by a brief description of a spiking neural model due to Maass et al. The paper I'm discussing is available as #148 from Wolfgang's website (it's in press at J. of Physiology). But I'd really like to see someone (else) tackle #165 sometime soon. Any takers? |
| 10 Jun 2005 |
Mukhlis |
Review of a paper by Chen and Chen |
We reviewed "Toward an evolvable neuromolecular hardware: a hardware design for a multilevel artificial brain with digital circuits", Jong-Chen Chen and Ruey-Dong Chen, Neurocomputing 42 (2002) 9-34. |
| 3 Jun 2005 |
Yun Zhang |
Poly & prior schema. |
The talk will present a couple of ideas in my Masters (on inductive logic programming) -- Polly and Prior Schema. Polly is for reducing the complexity from exponential to polynomial. Prior is to do with our sort of training examples. They turn out to depend on each other so I will present them both. Specifically they have 100% to do with probabilities, 10% with information theory, 50% with neural networks, 10% with belief nets, 30% with logics, 20% with philosophy, and 5% with version space (some normalisation is required). |
| 27 May 2005 |
Russell Tod |
Spiking neuron models for control. |
The talk will present results from my honours project, which investigates realistic models for biological neurons by embedding them in simulated physical agents. These agents attempt to control simple dynamical systems well - for example balancing poles, avoiding obstacles, and the pursuit and evasion of other agents. Their performance on these tasks highlights certain aspects of these realistic neurons compared to the usual "neurons" found in neural nets. |
| 6 May 2005 |
Ryan Woodard |
Memory. |
Is memory the same process in plasmas, SOC models and brains? |
| 29 Apr 2005 |
Marcus Frean |
GAs to go (can I get fries with that?) |
This talk will outline A Topic in Computer Science, or similar. Pondy has agreed to provide interjections. (in fact it was about density modelling using flow-field information from a camera mounted on a car...) |
| 22 Apr 2005 |
Chris Brookes (SES) |
Lost in space: 7 reasons why geography is hard. |
"Nearly everything happens somewhere, and where it happens matters". People understand this intuitively in everyday life but increasingly, with the support of computers and information systems, people are applying geography to make major decisions about managing the world we live in. So geography is important. Unfortunately it is also hard. In this seminar I will introduce some fundamental geographic problems, show why they are hard, and talk about some of the attempts to tackle them using computation. Geocomputation is a relatively new field that has developed from a fusion of Geographical Information Systems and computational methods, and makes significant use of novel techniques such as cellular automata, genetic algorithms, neural networks and multi-agent simulations. Anyone with an interest in spatial questions or any computer scientist looking for a real application is welcome to join the discussion. |
| 15 Apr 2005 |
Phillip Boyle |
Which way is up? |
What's the best way to estimate the gradient of a noisy function? Among other things, we might want to do this to help solve stochastic optimisation problems. Simple methods use finite differences. Other methods find interpolating models, and then differentiate the model. The method I have here fits a Gaussian Process model around the point at which you want the gradient. Fortunately, the derivative of a Gaussian Process is itself a Gaussian Process - and this has some helpful consequences. I'll give some examples of this, and try to explain how it works. |
| 8 Apr 2005 |
Daniel Crabtree |
The problems of searching the web, web clustering, and possible solutions. |
This will be an informal talk about the problems that exist with search the web, the capabilities of web clustering and how far it currently goes in addresses the problems of searching the web, and my possible solutions for how the remaining problems could be solved. The talk will start with a brief look at the big picture and the ultimate goal of search and more specifically the ultimate way of obtaining information. |
| 1 Apr 2005 |
Maciej Wojnar |
Planning as Communication. |
I'm going to talk about a paper I read that presents an interesting approach to planning. |
| 23 Mar 2005 |
Will Smart |
Communal Binary Decomposition for Multiclass object classification. |
A trial run of his EuroGP presentation. |
| 18 Mar 2005 |
Peter Andreae |
|
Learning to behave in structured worlds: what? and why? |
|
| 11 Mar 2005 |
Jeromé Dolman |
The Inductive Stochastic Model. |
Talking about my work over the past few weeks on blending induction into a stochastic model from the Koulakov-Tsigankov paper. First I'll cover the basic idea of their paper, then move on to the details and analysis of my additions to their model. |
| 4 Mar 2005 |
Richard |
Ricard, David, Alan and me. |
Solé et al paper on complex ecosystems and self-organised instability. Local copy here. |
| 25 Feb 2005 |
Daniel Crabtree |
Automatic Meaning Discovery Using Google. |
Exploration of the method described in http://www.danielcrabtree.com/papers/0412098.pdf (Cilibrasi & Vitanyi). Basically it’s an interesting paper about finding some kind of relationship or meaning or semantics of words, word-pairs, phrases, etc using Google. I see it as having applications for clustering and in improving clustering results, for instance, they give an example of it separating colours from numbers using Google. They also show that given simple examples of terms, it can extract the 'gist' of their semantic relationship to other terms. I'm more interested in discussing the idea of the technique and its applications, and while it is based on some Bayesian, statistical, and other mathematical constructs, I will not be talking about these in great detail; so if you have any questions, turn to the paper, as that is what I would be doing. I intend to give a brief introduction on the paper and its techniques (brief relative to last weeks), then to move to open discussion amongst the group. |
| 18 Feb 2005 |
Phillip |
Bayesian Neural Nets. |
Basic introduction to and revision of Bayesian Neural Networks for regression, as dealt with by Radford Neal and perhaps David MacKay. I plan to give a demonstration showing how MCMC sampling works, and how this can be used to perform regression and make predictions using Bayesian Neural Networks. |
| 11 Feb 2005 |
Marcus Frean |
Genetic Information and Self Organised Criticality |
Discussion of the above paper (Wills, Marshall and Smith 2005 - Europhysics letters). See my crude notes on the (old) FoD wiki. |
| 3 Feb 2005 |
Russell Tod |
Spiking neuron models for control tasks. |
|
| 1 Jan 2005 |
Cam Skinner |
Mutation, Schmutation. |
|