4 Commits

Author	SHA1	Message	Date
lucidrains	e8678364ba	swish glu feedforward from shazeer et al	2025-10-01 09:28:25 -07:00
lucidrains	8ebb8a9661	finished a first pass at digesting the paper, start with transformer	2025-10-01 09:21:55 -07:00
lucidrains	e0dd4cfeaa	they replace the recurrent state-space model with a transformer, with the implication that the former does not scale	2025-10-01 07:59:02 -07:00
lucidrains	bdc7dd30a6	scaffold	2025-10-01 07:18:23 -07:00