Alexander Bork

- alexander.bork@cs.rwth-aachen.de
- Address
- Room 4205
Ahornstraße 55
D-52074 Aachen - Phone
- +49 241 80 21252
I have been a PhD student at the Software Modeling and Verification Group (MOVES) headed by Professor Joost-Pieter Katoen since April 2021. Additionally, I am a doctoral researcher within the Research Training Group UnRAVeL.
Research
We cannot avoid POMDPs (…) because the real world is one.
Stuart J. Russel, Peter Norvig
Artificial Intelligence – A Modern Approach (Fourth Edition), p.578
My research focus is on the verification of partially observable stochastic models, in particular the analysis of partially observable Markov decision processes (POMDPs). In contrast to classical stochastic models, in partially observable models a decision maker must base its decisions on the available information in a state and not the complete state itself. A special focus of my work is the development of approaches that can be used in practice to verify certain properties on partially observable models and to synthesise strategies for such properties.
I am also interested in general topics of probabilistic verification, in particular probabilistic model checking.
I am a developer of the probabilistic model checker Storm.
Thesis Projects
If you are interested in writing a Bachelor’s/Master’s thesis within my research area, don’t hesitate to contact me!
Finished Projects
- Sven Büge, Implementing Goal-HSVI for POMDPs in the Probabilistic Model Checker Storm, Bachelor’s Thesis, 2024.
- Umut Dural, Automatic Algorithm Selection for Probabilistic Model Checking using Machine Learning, Bachelor’s Thesis, 2023.
- Gergana Tropcheva, Strategy Computation for a Markovian Disease Spread Model, Bachelor’s thesis, 2023.
- Christina Gehnen, POMDP-based Execution Models for Probabilistic Programs with Partial Observability, Master’s thesis, 2022. (co-supervised with Tobias Winkler)
Peer Reviews
Journals
- Logical Methods in Computer Science (lmcs) 2022/23 – Reviewer
Conferences
- TACAS 2025 – Subreviewer
- AAMAS 2025 – Subreviewer
- FM 2024 – Subreviewer
- UAI 2024 – External Reviewer
- TACAS 2024 – Member of Artifact Evaluation Committee
- AAMAS 2024 – Subreviewer
- UAI 2023 – External Reviewer
- TACAS 2023 – Member of Artifact Evaluation Committee
- CAV 2022 – External Reviewer
- FoSSaCS 2022 – External Reviewer
Teaching
I’m currently involved in the following teaching activities:
- Lecture: Model Checking (W 24)
- Seminar: Probabilistic Programming (W 24)
Past Semesters
- Seminar: Trends in Model Checking (S 24)
- Proseminar: Data Structures and Algorithms (S 24)
- Lecture: Modeling and Verification of Probabilistic Systems (W 23)
- Lecture: Model Checking (S 23)
- Proseminar: Programming Languages (S 23)
- Seminar: Probabilistic Programming (W 22)
- Lecture: Model Checking (S 22)
- Proseminar: Introduction to Program Analysis (S 22)
- Lecture: Modeling and Verification of Probabilistic Systems (S 21)
Publications
Own publications
2026
- Journal article
Search and explore: symbiotic policy synthesis in POMDPs
Formal methods in system design
2025
- Conference paper
Multi-Cost-Bounded Reachability Analysis of POMDPs
Conference on Uncertainty in Artificial Intelligence, 21-25 July 2025, Rio Othon Palace, Rio de Janeiro, Brazil
- Conference paper
Tools at the Frontiers of Quantitative Verification : QComp 2023 Competition Report
TOOLympics Challenge 2023
2024
- Conference paper
Learning Explainable and Better Performing Representations of POMDP Strategies
Tools and algorithms for the construction and analysis of systems
2023
2022
- Conference paper
Under-Approximating Expected Total Rewards in POMDPs
Tools and Algorithms for the Construction and Analysis of Systems
2021
- Master’s thesis
Underapproximations for indefinite-horizon POMDPS
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Gerhard Lakemeyer
Consultants: Tim Quatmann
2020
- Conference paper
Verification of Indefinite-Horizon POMDPs
Automated technology for verification and analysis
Supervised theses
2026
- Master’s thesis
Deciding orbit finiteness of linear dynamical systems with applications to markov chains
RWTH Aachen University
Advisers: Jürgen Giesl, Joost-Pieter Katoen
Consultants: Alexander Nikolai Bork, Nils Michael Lommen, Tobias Winkler
2024
- Bachelor’s thesis
Implementing Goal-HSVI for POMDPs in the probabilistic model checker Storm
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Alexander Nikolai Bork
2023
- Bachelor’s thesis
Automatic algorithm selection for probabilistic model checking using machine learning
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Tim Quatmann, Alexander Nikolai Bork
- Bachelor’s thesis
Strategy computation for a Markovian disease spread model
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Alexander Nikolai Bork
2022
- Master’s thesis
POMDP-based execution models for probabilistic programs with partial observability
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Alexander Nikolai Bork, Tobias Winkler