From REINFORCE to PPO/GRPO - Homepage
The home page of PG series.
Harry Huang's Blog
Notes on Mathematics, Computer Science, and more.
No matching posts.
TRPO and PPO
From the KL-constrained update to TRPO and PPO's clipped surrogate objective.
Introduction to Reinforcement Learning
A brief introduction to RL.
Intro to REINFORCE
Introduction to REINFORCE algorithm.
On-policy and Off-policy
Introduction to complete on-policy and off-policy algorithms.
Introduction to Module Theory
A introduction to Module Theory.
Polynomial Rings
A introduction to Polynomial Rings.
Euclidean / Principal Ideal / Unique Factorization Domain
A introduction to the concept of Euclidean Domain, Principal Ideal Domain, and Unique Factorization Domain.
Ring
A brief introduction to ring theory.
My Journey @ ICPC NAC 2025
Some thoughts after NAC.
Group Action
An introduction to group actions.
Treap
An introduction to Treap (BST).
Groups
An introduction to group theory.
Application of Group Theory
Some Applications of group theory.
Chain and Antichain
An introduction to chains and antichains.
Basic Topology on Metric Spaces
My study note for basic topology (mainly on metric spaces). I followed Baby Rudin Chapter 2. Please try to understand all of the concepts in this article before reading any other my blogs about topology.
General Topology - Intro and Continuous Functions
An introduction to general topology and continuous functions. Please try to understand all of the concepts on this article before reading other articles of general topology.
General Topology - Finite Product Topology
An introduction to finite product topology. This is the 3rd article about general topology.
General Topology - Order Topology
An introduction to order topology.
General Topology - Subspace Topology
An introduction to general topology and continuous functions.
Generating Functions
An introduction to generating functions.