Bishdata commited on
Commit
a1d205c
·
verified ·
1 Parent(s): 28b7225

Initial commit

Browse files
Files changed (5) hide show
  1. .gitattributes +1 -0
  2. README.md +88 -0
  3. dqn-EnduroNoFrameskip-v4.zip +3 -0
  4. replay.mp4 +0 -0
  5. results.json +1 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.mp4 filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,88 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: stable-baselines3
3
+ tags:
4
+ - EnduroNoFrameskip-v4
5
+ - deep-reinforcement-learning
6
+ - reinforcement-learning
7
+ - stable-baselines3
8
+ model-index:
9
+ - name: DQN
10
+ results:
11
+ - task:
12
+ type: reinforcement-learning
13
+ name: reinforcement-learning
14
+ dataset:
15
+ name: EnduroNoFrameskip-v4
16
+ type: EnduroNoFrameskip-v4
17
+ metrics:
18
+ - type: mean_reward
19
+ value: 3.20 +/- 5.58
20
+ name: mean_reward
21
+ verified: false
22
+ ---
23
+
24
+ # **DQN** Agent playing **EnduroNoFrameskip-v4**
25
+ This is a trained model of a **DQN** agent playing **EnduroNoFrameskip-v4**
26
+ using the [stable-baselines3 library](https://github.com/DLR-RM/stable-baselines3)
27
+ and the [RL Zoo](https://github.com/DLR-RM/rl-baselines3-zoo).
28
+
29
+ The RL Zoo is a training framework for Stable Baselines3
30
+ reinforcement learning agents,
31
+ with hyperparameter optimization and pre-trained agents included.
32
+
33
+ ## Usage (with SB3 RL Zoo)
34
+
35
+ RL Zoo: https://github.com/DLR-RM/rl-baselines3-zoo<br/>
36
+ SB3: https://github.com/DLR-RM/stable-baselines3<br/>
37
+ SB3 Contrib: https://github.com/Stable-Baselines-Team/stable-baselines3-contrib
38
+ SBX (SB3 + Jax): https://github.com/araffin/sbx
39
+
40
+ Install the RL Zoo (with SB3 and SB3-Contrib):
41
+ ```bash
42
+ pip install rl_zoo3
43
+ ```
44
+
45
+ ```
46
+ # Download model and save it into the logs/ folder
47
+ python -m rl_zoo3.load_from_hub --algo dqn --env EnduroNoFrameskip-v4 -orga Bishdata -f logs/
48
+ python -m rl_zoo3.enjoy --algo dqn --env EnduroNoFrameskip-v4 -f logs/
49
+ ```
50
+
51
+ If you installed the RL Zoo3 via pip (`pip install rl_zoo3`), from anywhere you can do:
52
+ ```
53
+ python -m rl_zoo3.load_from_hub --algo dqn --env EnduroNoFrameskip-v4 -orga Bishdata -f logs/
54
+ python -m rl_zoo3.enjoy --algo dqn --env EnduroNoFrameskip-v4 -f logs/
55
+ ```
56
+
57
+ ## Training (with the RL Zoo)
58
+ ```
59
+ python -m rl_zoo3.train --algo dqn --env EnduroNoFrameskip-v4 -f logs/
60
+ # Upload the model and generate video (when possible)
61
+ python -m rl_zoo3.push_to_hub --algo dqn --env EnduroNoFrameskip-v4 -f logs/ -orga Bishdata
62
+ ```
63
+
64
+ ## Hyperparameters
65
+ ```python
66
+ OrderedDict([('batch_size', 100),
67
+ ('buffer_size', 100000),
68
+ ('env_wrapper',
69
+ ['stable_baselines3.common.atari_wrappers.AtariWrapper']),
70
+ ('exploration_final_eps', 0.13071780683854003),
71
+ ('exploration_fraction', 0.4477029703130554),
72
+ ('frame_stack', 4),
73
+ ('gamma', 0.9),
74
+ ('gradient_steps', 1),
75
+ ('learning_rate', 0.00011447658254850165),
76
+ ('learning_starts', 20000),
77
+ ('n_timesteps', 100000.0),
78
+ ('optimize_memory_usage', False),
79
+ ('policy', 'CnnPolicy'),
80
+ ('target_update_interval', 1000),
81
+ ('train_freq', 8),
82
+ ('normalize', False)])
83
+ ```
84
+
85
+ # Environment Arguments
86
+ ```python
87
+ {'render_mode': 'rgb_array'}
88
+ ```
dqn-EnduroNoFrameskip-v4.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d44b6a3c0804937805ea83310dc3b71aa95fab352e10a709ec3f5a575d0b31a0
3
+ size 27242497
replay.mp4 ADDED
Binary file (369 kB). View file
 
results.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"mean_reward": 3.2, "std_reward": 5.582114294781146, "is_deterministic": false, "n_eval_episodes": 10, "eval_datetime": "2024-12-08T11:17:37.917661"}