tsilva/CartPole-v1-CartPole-v1-ppo-test-run

CartPole-v1 — CartPole-v1 with ppo (run test-run)

This repository contains artifacts from a Gymnasium Solver training run.

Contents

• Config: artifacts/configs/config.json
• Checkpoints: artifacts/checkpoints/*.ckpt
• Logs: artifacts/logs/*.log

Config (excerpt)

{
  "env_id": "CartPole-v1",
  "algo_id": "ppo",
  "n_steps": 8,
  "batch_size": 8,
  "n_epochs": 1,
  "n_timesteps": 8,
  "seed": 42,
  "n_envs": 1,
  "obs_type": "rgb",
  "policy": "MlpPolicy",
  "learning_rate": 0.001,
  "gamma": 0.98,
  "gae_lambda": 0.8,
  "ent_coef": 0.0,
  "vf_coef": 0.5,
  "clip_range": 0.2,
  "normalize_advantages": "batch"
}