Speaker: Dr. Azam Asanjarani (The University of Queensland)

We consider a simple discrete-time controlled queueing system, where the controller has a choice of which server to use at each time slot and server performance varies according to a Markov modulated random environment. We explore the role of information in the system stability region. At the extreme cases of information availability, that is when there is either full information or no information, stability regions and maximally stabilizing policies are trivial. But in the more realistic cases where only the environment state of the selected server is observed, only the service successes are observed or only queue length is observed, finding throughput maximizing control laws is a challenge. To handle these situations, we devise a Partially Observable Markov Decision Process (POMDP) formulation of the problem and illustrate properties of its solution. We further model the system under given decision rules, using Quasi-Birth-and-Death (QBD) structure to find a matrix analytic expression for the stability bound.

About Statistics, modelling and operations research seminars

Students, staff and visitors to UQ are welcome to attend our regular seminars.

The events are jointly run by our Operations research and Statistics and probability research groups, and colleagues in the Centre for Applications in Natural Resource Mathematics.

Seminars are usually held on Tuesdays from 11am to 12pm.

Information for speakers

Plan to speak for up to 40 minutes, and allow up to 15 minutes for questions and discussion.

Pitch your presentation to an interdisciplinary mathematical audience.

To avoid technical delays on the day, contact us a few days in advance of your presentation to discuss requirements.

You can either email us your presentation in advance, or save it to a memory stick. Microsoft PowerPoint presentations and PDFs are the most convenient file formats, but you can also run the talk from your own laptop.

Venue

Priestley Building (67)
Room: 
442