hongshaorou/Tianshou
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Tianshou/docs/api/tianshou.utils.rst

36 lines
514 B
ReStructuredText
Raw Normal View History

test api doc
2020-04-02 09:07:04 +08:00
tianshou.utils
==============
.. automodule:: tianshou.utils
:members:
:undoc-members:
:show-inheritance:
Remove dummy net code (#123) * remove dummy net; delete two files * split code to have backbone and head * rename class * change torch.float to torch.float32 * use flatten(1) instead of view(batch, -1) * remove dummy net in docs * bugfix for rnn * fix cuda error * minor fix of docs * do not change the example code in dqn tutorial, since it is for demonstration Co-authored-by: Trinkle23897 <463003665@qq.com>
2020-07-09 22:57:01 +08:00
Step collector implementation (#280) This is the third PR of 6 commits mentioned in #274, which features refactor of Collector to fix #245. You can check #274 for more detail. Things changed in this PR: 1. refactor collector to be more cleaner, split AsyncCollector to support asyncvenv; 2. change buffer.add api to add(batch, bffer_ids); add several types of buffer (VectorReplayBuffer, PrioritizedVectorReplayBuffer, etc.) 3. add policy.exploration_noise(act, batch) -> act 4. small change in BasePolicy.compute_*_returns 5. move reward_metric from collector to trainer 6. fix np.asanyarray issue (different version's numpy will result in different output) 7. flake8 maxlength=88 8. polish docs and fix test Co-authored-by: n+e <trinkle23897@gmail.com>
2021-02-19 10:33:49 +08:00
Pre-defined Networks
--------------------
fix venv seed, add TOC in docs, and split buffer.py into several files (#303) Things changed in this PR: - various docs update, add TOC - split buffer into several files - fix venv action_space randomness
2021-03-02 12:28:28 +08:00
Common
~~~~~~
Remove dummy net code (#123) * remove dummy net; delete two files * split code to have backbone and head * rename class * change torch.float to torch.float32 * use flatten(1) instead of view(batch, -1) * remove dummy net in docs * bugfix for rnn * fix cuda error * minor fix of docs * do not change the example code in dqn tutorial, since it is for demonstration Co-authored-by: Trinkle23897 <463003665@qq.com>
2020-07-09 22:57:01 +08:00
.. automodule:: tianshou.utils.net.common
:members:
:undoc-members:
:show-inheritance:
fix venv seed, add TOC in docs, and split buffer.py into several files (#303) Things changed in this PR: - various docs update, add TOC - split buffer into several files - fix venv action_space randomness
2021-03-02 12:28:28 +08:00
Discrete
~~~~~~~~
Remove dummy net code (#123) * remove dummy net; delete two files * split code to have backbone and head * rename class * change torch.float to torch.float32 * use flatten(1) instead of view(batch, -1) * remove dummy net in docs * bugfix for rnn * fix cuda error * minor fix of docs * do not change the example code in dqn tutorial, since it is for demonstration Co-authored-by: Trinkle23897 <463003665@qq.com>
2020-07-09 22:57:01 +08:00
.. automodule:: tianshou.utils.net.discrete
:members:
:undoc-members:
:show-inheritance:
fix venv seed, add TOC in docs, and split buffer.py into several files (#303) Things changed in this PR: - various docs update, add TOC - split buffer into several files - fix venv action_space randomness
2021-03-02 12:28:28 +08:00
Continuous
~~~~~~~~~~
Remove dummy net code (#123) * remove dummy net; delete two files * split code to have backbone and head * rename class * change torch.float to torch.float32 * use flatten(1) instead of view(batch, -1) * remove dummy net in docs * bugfix for rnn * fix cuda error * minor fix of docs * do not change the example code in dqn tutorial, since it is for demonstration Co-authored-by: Trinkle23897 <463003665@qq.com>
2020-07-09 22:57:01 +08:00
.. automodule:: tianshou.utils.net.continuous
:members:
:undoc-members:
:show-inheritance:
Reference in New Issue Copy Permalink