architecture design

tianshou/core/README.md

@@ -0,0 +1,24 @@
+# Core
+
+## Optimizer
+TODO:
+
+### policy based:
+
+Vanilla
+
+Baseline
+
+TRPO
+
+PPO
+
+NAF
+
+GAE
+
+DPG
+
+### value based:
+
+TD

tianshou/optimizer/README.md

@@ -1,11 +1,20 @@
 # Optimizer for policy gradient methods
 TODO:
+
 vanilla
-introduce a baseline
+
+baseline
+
 REINFORCE
+
 TRPO
+
 PPO
+
 GAE
+
 NAF
+
 DPG
-ACKTR 
+
+ACKTR