The engine is too weak to drive straight up the right hill — rock back and forth to
build momentum, then reach the flag. This is the exact environment your PPO agent trains on.
Observation (what the agent sees)
-0.50
0.000
Action (you)
◀ push left
coast
push right ▶
🏁 Reached the flag! Press reset to play again.
30 steps/s
Hold ←/A to push left, →/D to push right
(or the buttons); release to coast. The three discrete actions are push-left / coast / push-right.
The car starts at the bottom of the valley with zero velocity.