google
/

gemma-scope-9b-pt-res

Model card Files Files and versions

gemma-scope-9b-pt-res / layer_12 /width_16k

Ctrl+K

Ctrl+K

2 contributors

History: 7 commits

Tom Lieberum

9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5

745af8a 8 months ago

average_l0_10
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 8 months ago
average_l0_130
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 8 months ago
average_l0_19
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 8 months ago
average_l0_287
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 8 months ago
average_l0_33
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 8 months ago
average_l0_64
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 8 months ago