Biography
I am a Ph.D. student at the University of Tokyo advised by Dr. Tadashi Kozuno and Prof. Yutaka Matsuo. I received my master’s degree at Nara Institute of Science and Technology advised by Prof. Takamitsu Matsubara.
Download my resumé.
Interests
- Reinforcement Learning (Theory)
- Bandit Algorithms
- (Robotics)
Education
-
Ph.D. in Engineering, 2022-2025
The University of Tokyo
-
M.S. of Science and Technology, 2020-2022
Nara Institute of Science and Technology
-
Exchange Student, 2018
University of California Davis
-
B.E. in Science and Technology, 2016-2020
Keio University
Selected Publications
(2024).
A Policy Gradient Primal-Dual Algorithm for Constrained MDPs with Uniform PAC Guarantees.
arXiv preprint arXiv:2401.17780.
(2023).
Regularization and Variance-Weighted Regression Achieves Minimax Optimality in Linear MDPs: Theory and Practice.
International Conference on Machine Learning (ICML).
(2022).
KL-Entropy-Regularized RL with a Generative Model is Minimax Optimal.
arXiv preprint arXiv:2205.14211.
(2021).
Cautious Actor-Critic.
Asian Conference on Machine Learning (ACML).
(2021).
Cautious Policy Programming: Exploiting KL Regularization in Monotonic Policy Improvement for Reinforcement Learning.
arXiv preprint arXiv:2107.05798.
(2021).
Geometric Value Iteration: Dynamic Error-Aware KL Regularization for Reinforcement Learning.
Asian Conference on Machine Learning (ACML).
Domestic Conference and Workshop Papers
(2023).
(OS 招待講演) 逐次意思決定における諸問題設定と問題に関する事前知識が性能保証に及ぼす影響について.
人工知能学会全国大会論文集 第 37 回 (2023).
(2021).
ShinRL: A Library for Evaluating RL Algorithms from Theoretical and Practical Perspectives.
arXiv preprint arXiv:2112.04123.
Working Experience
Research Part-time
Research Internship
Engineering Internship
Research Internship
Engineering Intern
Projects
*
