Search

Continual learning systems must remain plastic enough to learn new tasks while stable enough to avoid catastrophic forgetting, but this tradeoff is increasingly constrained by memo…

We propose the problem of designing a dynamic, continuously-adaptive activation function that embeds continual-learning inductive biases directly into neuron nonlinearity. The targ…