google
/

gemma-scope-9b-pt-res

Model card Files Files and versions Community

gemma-scope-9b-pt-res / layer_20 /width_16k

2 contributors

History: 8 commits

Tom Lieberum

9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5

745af8a about 1 month ago

average_l0_11
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago
average_l0_138
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago
average_l0_20
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago
average_l0_310
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago
average_l0_36
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago
average_l0_408
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago
average_l0_58
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago
average_l0_68
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago