carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							830969d662 
							
						 
					 
					
						
						
							
							Update .readthe  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:47:40 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							fa55217118 
							
						 
					 
					
						
						
							
							Remove get_started.rst page with links to outdated notebooks  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:47:09 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							a12b157ee8 
							
						 
					 
					
						
						
							
							Add launch button for notebooks in colab  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:47:09 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							f5041f4f76 
							
						 
					 
					
						
						
							
							Replaced .png images with .svg where possible  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:47:09 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							cf3e94a79d 
							
						 
					 
					
						
						
							
							Update .readthedocs.yaml  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:47:08 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							a8bceff01e 
							
						 
					 
					
						
						
							
							Moved all docs images in docs/_static  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:47:08 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							6fa536fd46 
							
						 
					 
					
						
						
							
							Update Documentation building  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:47:08 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							6f739ccfe6 
							
						 
					 
					
						
						
							
							update docs/.gitignore  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:46:34 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							89d8cf3913 
							
						 
					 
					
						
						
							
							Removed action for gh-pages  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:46:18 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							42d9599f2b 
							
						 
					 
					
						
						
							
							Fix docs/requirements.txt  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:46:18 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							9ab5d350c2 
							
						 
					 
					
						
						
							
							Fix docs/requirements.txt  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:46:18 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							06d2703dfc 
							
						 
					 
					
						
						
							
							Fix docs/requirements.txt  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:46:17 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							4693b0bfc6 
							
						 
					 
					
						
						
							
							Remove autogenerated docs/api/highllevel  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:46:16 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							396f20b9bb 
							
						 
					 
					
						
						
							
							Fix docs/requirements.txt  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:46:16 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							6509a20b4b 
							
						 
					 
					
						
						
							
							Add autogenerated api to gitignore  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:46:16 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							573d53dc44 
							
						 
					 
					
						
						
							
							Fix docs/requirements.txt  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:45:54 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							08f1770fa2 
							
						 
					 
					
						
						
							
							Fix docs/requirements.txt  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:45:53 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							b1b7f24b94 
							
						 
					 
					
						
						
							
							Fix docs/requirements.txt  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:45:53 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							64af97b65e 
							
						 
					 
					
						
						
							
							Fix RTD and gh-pages docu auto-generation  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:45:53 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							9aad2c9673 
							
						 
					 
					
						
						
							
							Fix readthedocs to install poetry  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:45:53 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							fb97091a92 
							
						 
					 
					
						
						
							
							Fix action gh-pages  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:45:52 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							ca2e4a1d96 
							
						 
					 
					
						
						
							
							Fix docs index  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:45:52 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							102045c98c 
							
						 
					 
					
						
						
							
							Fix .readthedocs.yaml  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:45:51 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							8f0c62ace3 
							
						 
					 
					
						
						
							
							Documentation update: jupyter-book running on ReadTheDocs including tutorial notebooks  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:45:51 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							6df56161f5 
							
						 
					 
					
						
						
							
							Move notebooks to doc and resolve spellcheck  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:42:38 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							3a87b33d4f 
							
						 
					 
					
						
						
							
							Publish notebooks only from master  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:32 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							8489fde07e 
							
						 
					 
					
						
						
							
							Publish compiled Jupyter books to github-pages  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:32 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							b74ea40970 
							
						 
					 
					
						
						
							
							Add git-action to compile notebooks  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:32 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							624998d2eb 
							
						 
					 
					
						
						
							
							fix notebook action  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:22 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							30fc884078 
							
						 
					 
					
						
						
							
							Publish notebooks only on master  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:22 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							0108726dfe 
							
						 
					 
					
						
						
							
							fix build books action command  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:22 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							60f54fded9 
							
						 
					 
					
						
						
							
							Change gh-pages publish dir  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:21 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							1170ad37fd 
							
						 
					 
					
						
						
							
							Change gh-pages publish dir  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:21 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							23eadb11f8 
							
						 
					 
					
						
						
							
							Change books publish dir  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:21 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							c175f7647e 
							
						 
					 
					
						
						
							
							Fix notebooks.yml  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:21 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							bbe5da41f7 
							
						 
					 
					
						
						
							
							Add compiled books for documentation  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:21 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							0e9837fa17 
							
						 
					 
					
						
						
							
							Fix worklfow action compiling notebooks  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:20 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							04c374c439 
							
						 
					 
					
						
						
							
							add git-action to compile notebooks  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:20 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							96704a82a2 
							
						 
					 
					
						
						
							
							Update jupyter-book _config.yml to comply with template  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:20 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							148e11a1cd 
							
						 
					 
					
						
						
							
							Update notebooks to current version  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:20 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							de3a021a0a 
							
						 
					 
					
						
						
							
							Setup jupyter-book  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:41:19 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							7ed07031b7 
							
						 
					 
					
						
						
							
							Update gitignore  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:40:18 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							acc671b887 
							
						 
					 
					
						
						
							
							Update gitignore  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:39:13 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							6a60396839 
							
						 
					 
					
						
						
							
							Add jupyter pkg dependency to poetry env  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:37:38 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							efaadec6a1 
							
						 
					 
					
						
						
							
							Removed notebook outputs  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:36:47 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								carlocagnetta 
							
						 
					 
					
						
						
						
						
							
						
						
							6b6ce0fdf1 
							
						 
					 
					
						
						
							
							Add notebooks from ./docs/tutorials/get_started.rst to ./notebooks  
						
						 
						
						
						
						
					 
					
						2023-12-04 11:36:47 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								Michael Panchenko 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							8d3d1f164b 
							
						 
					 
					
						
						
							
							Support batch_size=None and use it in various scripts ( #993 )  
						
						 
						
						... 
						
						
						
						Closes  #986  
						
						
					 
					
						2023-11-24 10:13:10 -08:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								Michael Panchenko 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							f134bc20b5 
							
						 
					 
					
						
						
							
							Bugfix/discrete bcq inf ( #995 )  
						
						 
						
						... 
						
						
						
						Fixes a small bug with using np.inf instead of torch-based infinity
Closes  #963 
---------
Co-authored-by: ivan.rodriguez <ivan.rodriguez@unternehmertum.de> 
						
						
					 
					
						2023-11-24 11:17:40 +01:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								Matthew Turnshek 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							31fa0325fa 
							
						 
					 
					
						
						
							
							Update quickstart argument name ( #994 )  
						
						 
						
						... 
						
						
						
						Noticed an improper argument name when going through the quickstart. 
						
						
					 
					
						2023-11-22 21:05:37 -08:00  
					
					
						 
						
							
							
							 
						
					 
				 
			
				
					
						
							
							
								 
								Michael Panchenko 
							
						 
					 
					
						
						
							
							
						
						
						
							
						
						
							3a1bc18add 
							
						 
					 
					
						
						
							
							Method to compute actions from observations ( #991 )  
						
						 
						
						... 
						
						
						
						This PR adds a new method for getting actions from an env's observation
and info. This is useful for standard inference and stands in contrast
to batch-based methods that are currently used in training and
evaluation. Without this, users have to do some kind of gymnastics to
actually perform inference with a trained policy. I have also added a
test for the new method.
In future PRs, this method should be included in the examples (in the
the "watch" section).
To add this required improving multiple typing things and, importantly,
_simplifying the signature of `forward` in many policies!_ This is a
**breaking change**, but it will likely affect no users. The `input`
parameter of forward was a rather hacky mechanism, I believe it is good
that it's gone now. It will also help with #948  .
The main functional change is the addition of `compute_action` to
`BasePolicy`.
Other minor changes:
- improvements in typing
- updated PR and Issue templates
- Improved handling of `max_action_num`
Closes  #981  
						
						
					 
					
						2023-11-16 17:27:53 +00:00