From 824f4562cde15da9438a77fb585413dda896e63f Mon Sep 17 00:00:00 2001
From: Flange <122360007+MyRepositories-hub@users.noreply.github.com>
Date: Sun, 19 May 2024 12:29:10 +0800
Subject: [PATCH] Update README.md

---
 README.md | 8 ++++++++
 1 file changed, 8 insertions(+)

diff --git a/README.md b/README.md
index 0307f36..6bc7126 100644
--- a/README.md
+++ b/README.md
@@ -2,13 +2,16 @@
 ![MuJoCo](https://github.com/MyRepositories-hub/Simple-Policy-Optimization/blob/main/draw_return_mujoco.png)
 
 # Training
+
 **The experimental environment is `gymnasium`, and you need to execute the following command to install the dependencies:**
 ## MuJoCo
+
 ### Installation
 ```bash
 pip install gymnasium
 pip install gymnasium[mujoco]
 ```
+
 ### Reminder
 Please change the code from 
 ```python
@@ -33,12 +36,17 @@ while True:
         s_next, r, dw, tr, info = env.step(a)
         done = (dw or tr)
 ```
+
 ## Atari
+
 ### Installation
 ```bash
 pip install gymnasium[atari]
 pip install gymnasium[accept-rom-license]
 ```
+### Reminder
+v4 refers to the `gym` library, a popular reinforcement learning environment, while v5 represents its successor, `gymnasium`, which provides similar functionalities with potential improvements
+
 ### Running
 ```python
 import gymnasium as gym