mm
/
colors
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
Browse Source

remove depth = 8 and switch to relu

new-sep-loss
Michael Pilosov, PhD 10 months ago
parent
05dd4e29ce
commit
0c4990e98c
1 changed files with 2 additions and 2 deletions
Whitespace
Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL
Unified View
Diff Options
Show Stats Download Patch File Download Diff File
  1. 4
      newsearch.py

4
newsearch.py
View File

@ -30,7 +30,7 @@ learning_rate_values = [1e-3]
alpha_values = [1.0] alpha_values = [1.0]
# widths = [2**k for k in range(4, 13)] # widths = [2**k for k in range(4, 13)]
# depths = [1, 2, 4, 8, 16] # depths = [1, 2, 4, 8, 16]
widths, depths = [512], [4] widths, depths = [512], [1, 2, 4]
batch_size_values = [256] batch_size_values = [256]
max_epochs_values = [100] max_epochs_values = [100]
@ -79,7 +79,7 @@ python newmain.py fit \
--model.width {w} \ --model.width {w} \
--model.depth {d} \ --model.depth {d} \
--model.bias true \ --model.bias true \
--model.transform tanh \ --model.transform relu \
--trainer.min_epochs 10 \ --trainer.min_epochs 10 \
--trainer.max_epochs {me} \ --trainer.max_epochs {me} \
--trainer.log_every_n_steps 3 \ --trainer.log_every_n_steps 3 \

Write Preview
Loading…
Cancel
Save