architecture design patch

README.md

@@ -1,2 +1,27 @@
 # tianshou
 Tianshou(天授) is a reinforcement learning platform.
+## data
+TODO:
+
+Replay Memory
+
+Multiple wirter/reader
+
+Importance sampling
+
+## simulator
+go(for AlphaGo)
+
+## environment
+gym
+
+## core
+TODO:
+
+Optimizer
+
+MCTS
+
+## agent (optional)
+
+DQNAgent etc.

tianshou/optimizer/README.md

@@ -1,20 +0,0 @@
-# Optimizer for policy gradient methods
-TODO:
-
-vanilla
-
-baseline
-
-REINFORCE
-
-TRPO
-
-PPO
-
-GAE
-
-NAF
-
-DPG
-
-ACKTR