6 Commits

Author	SHA1	Message	Date
n+e	c91def6cbc	code format and update function signatures (#213) ... Cherry-pick from #200 - update the function signature - format code-style - move _compile into separate functions - fix a bug in to_torch and to_numpy (Batch) - remove None in action_range In short, the code-format only contains function-signature style and `'` -> `"`. (pick up from [black](https://github.com/psf/black))	2020-09-12 15:39:01 +08:00
Trinkle23897	34f714a677	Numba acceleration (#193) ... Training FPS improvement (base commit is 94bfb32): test_pdqn: 1660 (without numba) -> 1930 discrete/test_ppo: 5100 -> 5170 since nstep has little impact on overall performance, the unit test result is: GAE: 4.1s -> 0.057s nstep: 0.3s -> 0.15s (little improvement) Others: - fix a bug in ttt set_eps - keep only sumtree in segment tree implementation - dirty fix for asyncVenv check_id test	2020-09-02 13:03:32 +08:00
Trinkle23897	75364cd986	ppo and early stop	2020-03-20 19:52:29 +08:00
Trinkle23897	f58c1397c6	half of collector	2020-03-12 22:20:33 +08:00
Trinkle23897	7533e5b0ac	add first test	2020-03-11 10:56:38 +08:00
Trinkle23897	0dfb900e29	env and data	2020-03-11 09:09:56 +08:00