google
/

gemma-scope-9b-pt-res

Tom Lieberum

9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5

745af8a 8 months ago

27 Bytes

{"sparsity_lambda": 0.0001}