Tobias Winkler

- tobias.winkler@cs.rwth-aachen.de
- Address
- Room 4231
Ahornstraße 55
D-52074 Aachen - Phone
- +49 241 80 21205
I am a postdoctoral researcher in the Software Modeling and Verification Group headed by Professor Joost-Pieter Katoen. Moreover, I am associated with the research training group UnRAVel.
Research
My research focuses on formal verification of probabilistic systems, both from a theoretical and practical point of view. More specifically, my research interests include:
- Probabilistic Model Checking: Probabilistic Pushdown Automata, Markov Decision Processes, Stochastic Games, Multi-Objective Controller Synthesis, Temporal Logics, Certificates
- Quantitative Program Analysis: Probabilistic Programs, Weighted Programs, Quantitative Loop Invariants, Strategy Synthesis, Probability Generating Functions
PhD Thesis
I have defended my PhD thesis entitled
Verification and Certification of Probabilistic Recursive Programs via Pushdown Automata
on August 7, 2026. The thesis will be published soon.
Bachelor’s and Master’s Theses
If you are interested in writing a Bachelor/Master’s thesis in any of the areas mentioned above please contact thesis@i2.informatik.rwth-aachen.de for a general request.
Ongoing Thesis Projects
- Belief-Tracking POMDP Policies via Randomized Finite-State Controllers (working title). Bacherlor’s thesis. 2026. (Joint supervision with Lisa Pühl).
- Deciding Finiteness of the Belief Space of Markov Models (working title). Bachelor’s thesis. 2026. (Joint supervision with Alex Bork and Nils Lommen).
- A Zoo of Probabilistic Loops Invariants (working title). Bachelor’s thesis. 2026.
Past Thesis Projects
- Automata-based Semantics for the Probabilistic Programming Language ReDiP – Dominik Geißler, Master’s thesis. 2025.
Distributional Invariants for Probabilistic Programs – Daniel Zilken, Master’s thesis. 2024. (Joint supervision with Kevin Batz). - Most Probable Explanations in Bayesian Networks via Weighted Programming – Dinis Vitorino, Bachelor’s thesis. 2024. (Joint supervision with Kevin Batz).
- Model Checking Probabilistic PDA vs Unambiguous Automata – Anastasiia Petrova, Bachelor’s thesis. 2023.
- Invariant-based Strategy Synthesis for Nondeterministic Probabilistic Programs – Tom Biskup, Master’s thesis. 2022. (Joint supervision with Kevin Batz)
Tom has received the Berthold Vöcking Master Award for his thesis. - Pushdown and Expectation Transformer Semantics of Probabilistic Recursive Programs with Nested Conditioning – Johannes Lehmann, Master’s thesis. 2022.
- POMDP-based Execution Models for Probabilistic Programs with Partial Observability – Christina Gehnen, Master’s thesis. 2022. (Joint supervision with Alex Bork)
- Automatic Verification of Loop Invariants in Weighted Programs – Ben Sturgis, Bachelor’s thesis. 2022. (Joint supervision with Kevin Batz)
- Inference in Discrete Probabilistic Programs using Probability Generating Functions – Christian Blumenthal, Master’s thesis. 2022. (Joint supervision with Lutz Klinkenberg)
- Implementation of an LTL Model Checker for Probabilistic Pushdown Automata – Laura Bamberger, Bachelor’s thesis. 2022.
- Proving Termination of Probabilistic Recursive Programs via SMT-Solving – Leo Mommers, Bachelor’s thesis. 2022.
- Compositional Control-Flow Reduction for Probabilistic Model Checking – Naomi Barth, Bachelor’s thesis. 2021.
- Automata-based Model Checking of Recursive Systems – Christina Gehnen, Bachelor’s thesis. 2020.
Christina has received an award from the Fachgruppe Informatik for her thesis.
Student Assistants and Interns
In the past, I have supervised our research student assistants Johannes Lehmann, Christina Gehnen, Adrian Gallus, Tom Biskup, Samuel Rode, our DAAD RISE intern Arman Ozcan, and our interns Diane Cauquil (ENS Paris-Saclay) and Ivo Melse (Radboud University).
Teaching
Current Semester
Past Semesters
- Formale Sprachen, Automaten und Prozesse (“FoSAP”; Vorlesung) SS25
- Formale Sprachen, Automaten und Prozesse (“FoSAP”; Vorlesung) SS24
- Theoretical Foundations of the UML (Lecture) WS23/24
- Datenstrukturen und Algorithmen (“DSAL”; Vorlesung) SS23
- Probabilistic Programming (Lecture) WS22/23
- Probabilistic Programming (Seminar) WS22/23
- Static Program Analysis (Lecture) SS22
- Formal Verification Meets Machine Learning (Seminar) WS21/22
- Modelling and Verification of Probabilistic Systems (“MVPS”; Lecture) SS21
- Probabilistic Programming (Lecture) WS20/21
- Probabilistic Programming (Seminar) WS20/21
- Datenstrukturen und Algorithmen (“DSAL”; Vorlesung) SS20
- Introduction to Program Analysis (Proseminar) SS20
Awards
- Our paper Verifying Sampling Algorithms via Distributional Invariants with Daniel Zilken, Kevin Batz (Cornell), and Joost-Pieter Katoen has received the Best Paper Award at FM 2026.
- Our paper Generating Functions Meet Occupation Measures: Invariant Synthesis for Probabilistic Loops with Darion Haase, Kevin Batz, Adrian Gallus, Benjamin Lucien Kaminski, Joost-Pieter Katoen, and Lutz Klinkenberg won the joint distinguished artifact award of ESOP + FASE + FoSSaCS 2026.
- Our paper Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains with Hannah Mertens, Joost-Pieter Katoen, and Tim Quatmann has received the EAPLS best paper award at ETAPS 2024.
- Our paper Generating Functions for Probabilistic Programs with Lutz Klinkenberg, Kevin Batz, Benjamin Lucien Kaminski, Joost-Pieter Katoen and Joshua Moerman has received the best paper award at LOPSTR 2020.
- I was awarded the Springorum Medal in 2020 for receiving a master’s degree with distinction.
Peer Review
Journals
- Theoretical Computer Science (TCS) 2026 (reviewer)
- Logical Methods in Computer Science (LMCS) 2022 (reviewer)
- Formal Methods in System Design (FMSD) 2021 (external reviewer)
Conferences & Workshops
- ATVA 2026 (PC member)
- MFCS 2026 (external reviewer)
- LICS 2026 (external reviewer)
- STACS 2026 (external reviewer)
- CONCUR 2025 (external reviewer)
- CAV 2025 (external reviewer)
- TACAS 2025 (external reviewer)
- STACS 2025 (external reviewer)
- IJCAR 2024 (external reviewer)
- CAV 2024 (PC member Artifact Evaluation / external reviewer)
- AAMAS 2024 (external reviewer)
- SODA 2024 (external reviewer)
- MFCS 2023 (external reviewer)
- ATVA 2023 (external reviewer)
- SYNT 2023 @CAV 2023 (PC member)
- POPL 2023 (external reviewer)
- ICTAC 2022 (external reviewer)
- CONCUR 2022 (external reviewer)
- ICALP 2022 (external reviewer)
- LICS 2022 (external reviewer)
- CAV 2022 (PC member Artifact Evaluation / external reviewer)
- POPL 2022 (external reviewer)
- CONCUR 2021 (external reviewer)
- CAV 2021 (PC member Artifact Evaluation / external reviewer)
- FoSSaCS 2021 (external reviewer)
Selected Talks
- Who Verifies the Verifier? Certificates for Probabilistic Model Checking. Workshop talk at UnRAVeL Spring 2025. Aachen, Germany.
- Certifying Positive Almost Sure Termination of Probabilistic Pushdown Automata. Conference talk at Highlights 2024. Bordeaux, France.
- Programmtic Strategy Synthesis: Resolving Nondeterminism in Probabilistic Programs. Conference talk at POPL 2024. London, UK.
- Probabilistic Language Inclusion Problems. Guest Talk at IMDEA Software Institute, 2023. Madrid, Spain.
- On Certificates, Expected Runtimes, and Termination in Probabilistic Pushdown Automata. Conference talk at LICS 2023. Boston, USA.
- Certificates for Probabilistic Pushdown Automata via Optimistic Value Iteration. Conference talk at TACAS 2023. Paris, France.
- Model Checking Temporal Properties of Probabilistic Recursive Programs. Conference talk at FoSSaCS 2022. Munich, Germany.
- Out of Control: Reducing Probabilistic Models by Control State Elimination. Conference talk at VMCAI 2022. Philadelphia, USA.
- On the Complexity of Reachability in Parametric MDPs. Conference talk at CONCUR 2019. Amsterdam, The Netherlands.
Publications
See dblp or Google Scholar.
Own publications
2026
- Conference paper
Generating Functions Meet Occupation Measures: Invariant Synthesis for Probabilistic Loops
Programming languages and systems
PDF of Generating Functions Meet Occupation Measures: Invariant Synthesis for Probabilistic LoopsRWTH record for Generating Functions Meet Occupation Measures: Invariant Synthesis for Probabilistic LoopsBibTeX for Generating Functions Meet Occupation Measures: Invariant Synthesis for Probabilistic Loops - Journal article
Probabilistic programming meets automata theory: Exact inference using weighted automata
Theoretical computer science
- Conference paper
Correction to: Weighted Automata for Exact Inference in Discrete Probabilistic Programs
Theoretical Aspects of Computing – ICTAC 2025
- Conference paper
Weighted Automata for Exact Inference in Discrete Probabilistic Programs
Theoretical Aspects of Computing – ICTAC 2025
2025
- Conference paper
Correction to: Efficient Probabilistic Model Checking for Relational Reachability
Computer Aided Verification
- Conference paper
Efficient Probabilistic Model Checking for Relational Reachability
Computer Aided Verification
- Journal article
Computing Expected Visiting Times and Stationary Distributions in Markov Chains: Fast and Accurate
Journal of automated reasoning
PDF of Computing Expected Visiting Times and Stationary Distributions in Markov Chains: Fast and AccurateRWTH record for Computing Expected Visiting Times and Stationary Distributions in Markov Chains: Fast and AccurateBibTeX for Computing Expected Visiting Times and Stationary Distributions in Markov Chains: Fast and Accurate - Conference paper
Fixed Point Certificates for Reachability and Expected Rewards in MDPs
Tools and Algorithms for the Construction and Analysis of Systems
- Journal article
Proceedings of the ACM on programming languages
PDF of Foundations for Deductive Verification of Continuous Probabilistic Programs: From Lebesgue to Riemann and BackRWTH record for Foundations for Deductive Verification of Continuous Probabilistic Programs: From Lebesgue to Riemann and BackBibTeX for Foundations for Deductive Verification of Continuous Probabilistic Programs: From Lebesgue to Riemann and Back - Book chapter
Principles of verification: cycling the probabilistic landscape, Part 1
RWTH record for J-P: MDP. FP. PP: Characterizing Total Expected Rewards in Markov Decision Processes as Least Fixed Points with an Application to Operational Semantics of Probabilistic ProgramsBibTeX for J-P: MDP. FP. PP: Characterizing Total Expected Rewards in Markov Decision Processes as Least Fixed Points with an Application to Operational Semantics of Probabilistic Programs
2024
- Conference paper
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
Reachability problems
- Conference paper
Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains
Tools and algorithms for the construction and analysis of systems
PDF of Accurately Computing Expected Visiting Times and Stationary Distributions in Markov ChainsRWTH record for Accurately Computing Expected Visiting Times and Stationary Distributions in Markov ChainsBibTeX for Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains - Master’s thesis
Complexity and decidability of multi-objective stochastic games
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Jan Křetínský
Consultants: Maximilian Weininger
- Journal article
Programmatic Strategy Synthesis: Resolving Nondeterminism in Probabilistic Programs
Proceedings of the ACM on programming languages
2023
- Journal article
Model Checking Temporal Properties of Recursive Probabilistic Programs
Logical methods in computer science
- Conference paper
On Certificates, Expected Runtimes, and Termination in Probabilistic Pushdown Automata
2023 38th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS)
- Conference paper
Certificates for Probabilistic Pushdown Automata via Optimistic Value Iteration
Tools and Algorithms for the Construction and Analysis of Systems
2022
- Conference paper
Computer Aided Verification
PDF of Does a Program Yield the Right Distribution? Verifying Probabilistic Programs via Generating FunctionsRWTH record for Does a Program Yield the Right Distribution? Verifying Probabilistic Programs via Generating FunctionsBibTeX for Does a Program Yield the Right Distribution? Verifying Probabilistic Programs via Generating Functions - Journal article
Weighted programming : a programming paradigm for specifying mathematical models
Proceedings of the ACM on programming languages
- Conference paper
Model Checking Temporal Properties of Recursive Probabilistic Programs
Foundations of Software Science and Computation Structures
Supervised theses
2026
- Bachelor’s thesis
Belief-tracking policies for partially observable MDPs via randomized finite-state controllers
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Tim Quatmann
Consultants: Tobias Winkler, Lisa Pühl
2025
- Master’s thesis
Automata-based semantics for the probabilistic programming language ReDiP
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Tobias Winkler
2024
- Master’s thesis
Distributional invariants for probabilistic programs
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Kevin Batz, Tobias Winkler
- Bachelor’s thesis
Most probable explanations in Bayesian Networks via weighted programming
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Tobias Winkler, Kevin Batz
- Bachelor’s thesis
Model checking pPDA vs unambiguous automata
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Tobias Winkler
- Master’s thesis
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Tobias Winkler
PDF of Pushdown and expectation transformer semantics of probabilistic recursive programs with nested conditioningRWTH record for Pushdown and expectation transformer semantics of probabilistic recursive programs with nested conditioningBibTeX for Pushdown and expectation transformer semantics of probabilistic recursive programs with nested conditioning - Bachelor’s thesis
Proving termination of probabilistic recursive programs via SMT-solving
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Erika Ábrahám
Consultants: Tobias Winkler
- Bachelor’s thesis
Compositional control-flow reduction for probabilistic model checking
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Tobias Winkler
2022
- Bachelor’s thesis
Implementation of an LTL model checker for probabilistic pushdown automata
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Tobias Winkler
- Master’s thesis
Inference in discrete probabilistic programs using probability generating functions
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Lutz Klinkenberg, Tobias Winkler
- Bachelor’s thesis
Automatic verification of loop invariants in weighted programs
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Tobias Winkler, Kevin Batz
- Master’s thesis
POMDP-based execution models for probabilistic programs with partial observability
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Alexander Nikolai Bork, Tobias Winkler
2021
- Bachelor’s thesis
Automata-based model checking of recursive systems
RWTH Aachen University
Advisers: Joost-Pieter Katoen, Thomas Noll
Consultants: Tobias Winkler