Commits · Hazem/Fac256xc

fix(colab): use correct param name for CLIP

badd15c

boris commited on May 10, 2022

feat(colab): use full precision for clip & vqgan

8845d77

boris commited on May 9, 2022

feat(colab): require less memory

5f16fb0

boris commited on May 9, 2022

fix(train): overwrite dropout only when specified

89bc9d4

boris commited on May 5, 2022

feat: allow eval only

65bb95f

boris commited on May 5, 2022

feat(colab): update mini checkpoint

a4d2af8

boris commited on May 3, 2022

feat(train): allow editing dropout during training

80d791a

boris commited on May 3, 2022

feat(colab): require less resources

b6f5026

boris commited on May 3, 2022

feat(colab): change defaults

3de3769

boris commited on May 2, 2022

feat(colab): handle dalle-mega

024f8f5

boris commited on May 2, 2022

feat: support LR offset (#174)

c3e93df
unverified

boris commited on Apr 29, 2022

feat: update shampoo

79a3849

boris commited on Apr 29, 2022

feat(train): allow nesterov momentum

d08bf8d

boris commited on Apr 29, 2022

feat: allow weight decay

acc1a4a

boris commited on Apr 28, 2022

style: reformat

dca3ada

boris commited on Apr 20, 2022

feat(train): use new HF _do_init api

6b84155

boris commited on Apr 19, 2022

fix: model compatible with do_init

f3a8cbb

boris commited on Apr 19, 2022

fix: apply learning rate offset only when requested

c6263f3

boris commited on Apr 16, 2022

feat(train): arg to offset lr for resumed runs

89b4c45

boris commited on Apr 16, 2022

feat(demo): use vaild model

23c1ef6

boris commited on Apr 15, 2022

feat(mega): switch to gelu

cdefdd0

boris commited on Apr 15, 2022

fix: use correctly cache during inference + allow unscan (#170)

42968cf
unverified

boris commited on Apr 15, 2022

fix: allow non-scanned models (#168)

8ae9176
unverified

boris commited on Apr 15, 2022

feat: vmap optimizer (#166)

b993d27
unverified

boris commited on Apr 11, 2022

feat(demo): use fixed commit

2f1e5d9

boris commited on Apr 11, 2022

feat: scan layers + gradient checkpointing (#161)

07a6f9a
unverified

boris commited on Apr 9, 2022

feat: better multi-node support (#158)

728a3c3
unverified

boris commited on Apr 8, 2022

feat: update shampoo

9ecdd3f

boris commited on Apr 6, 2022

feat(demo): update model

b9a1a7d

boris commited on Apr 2, 2022

feat(model): allow bias (#152)

361a994
unverified

boris commited on Mar 30, 2022

feat(train): google-cloud-storage is optional

02b2308

boris commited on Mar 29, 2022

feat(train): rename logged config

955dc20

boris commited on Mar 29, 2022

feat: add mini_glu config

a7e5050

boris commited on Mar 28, 2022

feat: update mini config

d9a16f2

boris commited on Mar 25, 2022

feat: implement transformer variants (#144)

542378c
unverified

boris commited on Mar 24, 2022

feat(train): log norm and histograms (#143)

b7b619a
unverified

boris commited on Mar 19, 2022

feat(data): super conditioning (#141)

7939874
unverified

boris commited on Mar 17, 2022