Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding multi-fidelity optimizers #127

Open
wants to merge 149 commits into
base: Develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
149 commits
Select commit Hold shift + click to select a range
248c1b6
Implement first concepts of multi-fidelity
TillFetzer Nov 3, 2021
f8f35ad
Further working on SH optimizer
TillFetzer Nov 4, 2021
a4306c9
make trainer evaluation runnable on sh
TillFetzer Nov 9, 2021
fa58c39
work on sh optimizer & train_statistics
TillFetzer Nov 10, 2021
104432b
sh working
TillFetzer Nov 11, 2021
ff4c0de
beginn hyperband
TillFetzer Nov 16, 2021
d4cc57e
work on sh plot
lage2104 Nov 16, 2021
0ef00c5
Merge branch 'dev/lars' into multi-fidelity
TillFetzer Nov 17, 2021
1471cd5
work on sh plots & bug fixes in sh optimizer
TillFetzer Nov 17, 2021
51f2949
make HyperBand acces able
TillFetzer Nov 18, 2021
732b9e1
hyperband main code finish
TillFetzer Nov 18, 2021
43f5ebc
fixed config for sh
Nov 19, 2021
ee11f5b
work on optimizer stats
Nov 19, 2021
a02df1a
fixed hyperband calc
Nov 19, 2021
50b776d
tested hyperand
TillFetzer Nov 19, 2021
beea9c0
add other stop criterion to sh
TillFetzer Nov 19, 2021
2e475fe
make hb work
TillFetzer Nov 20, 2021
a665d3a
Merge branch 'dev/lars' into multi-fidelity
Nov 20, 2021
ecf2641
refactor plot code
Nov 20, 2021
52eb8f6
refactor sh optimizer & multi-fidelity trainer
Nov 20, 2021
1b4a258
refactor optimizer
Nov 20, 2021
1a961f6
refactor demo code for multi-fidelity
Nov 20, 2021
f98c658
refactor multi-fidelity demo and plot
Nov 20, 2021
0312d03
hyperband without stats workrd
TillFetzer Nov 23, 2021
2f3abfc
bug fix demo config
TillFetzer Nov 23, 2021
6f1eb79
Merge branch 'dev/till' into multi-fidelity
TillFetzer Nov 23, 2021
7cc1ad2
fix config after merging
TillFetzer Nov 23, 2021
473d977
extend multi-fidelity demo config
TillFetzer Nov 23, 2021
03b419e
run without statcis through
TillFetzer Nov 25, 2021
542b42e
some cleaning work
TillFetzer Nov 25, 2021
2bfc70b
add comment to budget calculation
Dec 1, 2021
53f385c
adapt budget for better compareability
Dec 1, 2021
17887fd
small bug fix in hb
TillFetzer Dec 1, 2021
cd12c34
beginn palnning bohb
TillFetzer Dec 2, 2021
7c8e9fa
plan bohb
TillFetzer Dec 5, 2021
31cd19a
merged
Dec 8, 2021
6814716
add optimizer stats to hb
Dec 8, 2021
59a034c
fix optimizer stats for hb
Dec 8, 2021
71d9dbf
delete obsolete function from mf plots
Dec 8, 2021
2e3d6ed
add hb plot function
Dec 8, 2021
0c9ad2d
codestyle on sh optimizer
Dec 8, 2021
17cc12c
codestyle of multifidelity trainer class
Dec 8, 2021
792c41e
Merge branch 'dev/till' into multi-fidelity
TillFetzer Dec 9, 2021
904d914
opti
TillFetzer Dec 10, 2021
45c3854
fix get finial archietktur
TillFetzer Dec 11, 2021
4ae6d03
start to train
TillFetzer Dec 12, 2021
149c51f
tpe in predictor
TillFetzer Dec 13, 2021
16f05eb
learned kde
TillFetzer Dec 17, 2021
2cccd52
delete old files
TillFetzer Dec 17, 2021
db3e543
beginn sample
TillFetzer Dec 20, 2021
f76ceeb
tpe further work
TillFetzer Jan 8, 2022
c7d11d7
hb fix
TillFetzer Jan 8, 2022
9b713cb
work on sh
Jan 8, 2022
19f60fb
Merge branch 'dev/lars' into multi-fidelity
Jan 8, 2022
54ab59e
group work on plot
TillFetzer Jan 8, 2022
2ac1631
make bohb extra
TillFetzer Jan 13, 2022
835c0f8
correct path for saving stats
Jan 15, 2022
1f94498
fix hb plot
Jan 15, 2022
492cc12
fix optimizer stats
Jan 15, 2022
258e094
fix plots and stats
Jan 15, 2022
ac1c250
bohb own script
TillFetzer Jan 15, 2022
32b798b
create plot for bohb
TillFetzer Jan 20, 2022
310d9af
Merge branch 'dev/lars' into multi-fidelity
TillFetzer Jan 20, 2022
c007bd8
work on benchmark setup
Feb 1, 2022
c9d0fc4
further improvments on experimental setup
Feb 2, 2022
9a91f56
config inconsquent in tpe
TillFetzer Feb 2, 2022
935ebd8
make bohb runnin againn
TillFetzer Feb 2, 2022
c2c46e2
update sh to use max_budget
Feb 3, 2022
436396b
bug fix on sh optimizer
Feb 5, 2022
a01ad47
fix in sh optimizer
Feb 8, 2022
1545afb
work on sh train time
Feb 9, 2022
1f48654
dehb bracket claculations right
TillFetzer Feb 10, 2022
c0e9613
change the hyperparamter into config file
TillFetzer Feb 15, 2022
936a7da
nas-bench-x11 clone
TillFetzer Feb 17, 2022
8a701cf
Merge branch 'dev/till' into multi-fidelity
TillFetzer Feb 17, 2022
1672c18
add parameter for multi-fidelity methods
Feb 17, 2022
ff53bca
Merge branch 'dev/lars' into multi-fidelity
Feb 17, 2022
a777c49
set up benchmark setup
Feb 18, 2022
d734183
sh works
TillFetzer Feb 18, 2022
fa87aa6
preparing benchmarks
Feb 20, 2022
e3b4a1d
add new runner for mf
Feb 21, 2022
16604a6
improvements in sbatch submit for mf experiments
Feb 21, 2022
d67e7c1
fix bug in sbatch
Feb 21, 2022
97c18e8
fix variable
Feb 21, 2022
871003f
fix runner for sbatch
Feb 21, 2022
ef2cb26
config change
TillFetzer Feb 22, 2022
b9df6cc
adapt sh configs
Feb 22, 2022
c6b3443
claculate training time
TillFetzer Feb 22, 2022
983d691
Merge branch 'dev/till' into multi-fidelity
TillFetzer Feb 22, 2022
ef8db00
ram little bit memory opt
TillFetzer Feb 25, 2022
a83b171
adapt sbatch submission
Feb 28, 2022
a7543a7
fixed runner
Feb 28, 2022
61c4022
Merge branch 'multi-fidelity' of github.com:automl/NASLib into multi-…
Feb 28, 2022
6c5289a
fix sbatch
Mar 1, 2022
39d5b42
test
TillFetzer Mar 13, 2022
4c7da87
config
TillFetzer Mar 13, 2022
c9218ef
config two
TillFetzer Mar 13, 2022
a8d8dc4
clean history remove
TillFetzer Mar 13, 2022
8155665
add submission script
Mar 14, 2022
a2d172b
clean history back in buisness
TillFetzer Mar 14, 2022
f62d4d2
doubble import
TillFetzer Mar 14, 2022
bac6cf1
Merge branch 'dev/till' into multi-fidelity
Mar 14, 2022
a1a54fc
fixed config script
Mar 14, 2022
ac8e3d8
fix range in config
Mar 14, 2022
47239d6
fix old runner
Mar 16, 2022
9807041
add plots for mf
Mar 17, 2022
cb5f3f5
tpe remove
TillFetzer Mar 17, 2022
666ce8c
Merge branch 'multi-fidelity' of github.com:automl/NASLib into multi-…
TillFetzer Mar 17, 2022
c1d30b0
plt opti
TillFetzer Mar 20, 2022
4086073
fix random seed & num_config from config
Mar 21, 2022
308c24a
bug fix in bohb & change config creation
Mar 25, 2022
27d3a9b
fix experimental setup
Apr 1, 2022
f01cbba
bug fix in dehb optimizer & mf runner
Apr 1, 2022
b47c1fb
Merge branch 'multi-fidelity' of github.com:automl/NASLib into multi-…
Apr 1, 2022
08d0a06
plot further work
TillFetzer Apr 1, 2022
79c7423
fix seed
TillFetzer Apr 1, 2022
23f86e1
fix range for mutate_prob
Apr 1, 2022
b535988
Merge branch 'multi-fidelity' of github.com:automl/NASLib into multi-…
Apr 1, 2022
64992b7
fix number
TillFetzer Apr 1, 2022
3bc42c4
Merge branch 'multi-fidelity' of github.com:automl/NASLib into multi-…
TillFetzer Apr 1, 2022
85a8ba9
merge
TillFetzer Apr 1, 2022
aa2b49d
hpo block
TillFetzer Apr 11, 2022
baa3b1b
hpo
TillFetzer Apr 11, 2022
45d5276
changes overt time
TillFetzer May 11, 2022
31fb115
add to our experiments
TillFetzer May 13, 2022
aed5c8a
fix lab mixed up
TillFetzer May 21, 2022
27bd186
Merge branch 'dev/till' into multi-fidelity
TillFetzer May 21, 2022
8d9be5a
make multifidelity consistend
TillFetzer May 21, 2022
14840fa
debug
TillFetzer May 22, 2022
bf1c03f
work on optimizer plot & improve mf-optimizers
Jun 11, 2022
a167037
Merge branch 'multi-fidelity' of github.com:automl/NASLib into multi-…
Jun 11, 2022
9faed3b
adapt train time
Jun 13, 2022
bceddf7
adapt min budget
Jun 13, 2022
ed96cb5
fix train time calculation
Jun 13, 2022
1abd9d1
fix min budget
Jun 14, 2022
892299a
implement kde for asr
Jun 14, 2022
3b806c1
adapt kde to asr
TillFetzer Jun 14, 2022
8e2b6e8
set fix seed for asr query
Jun 15, 2022
28e7004
comment in hb optimizer
Jun 17, 2022
f6533b0
delete obsolete files
Jun 17, 2022
3ffd401
code cleanup for trainer and multifidelity methods
Jun 17, 2022
e4c47ad
adapt train time in nasbenchasr
Jun 18, 2022
91a2ccc
removing prints
Jun 20, 2022
00b7c7b
plots generatisation
TillFetzer Jun 21, 2022
6aeeaa1
plots
TillFetzer Jun 21, 2022
a7cdffb
optimize mf experimental setup
Jul 14, 2022
c5bb566
Merge branch 'multi-fidelity' of github.com:automl/NASLib into multi-…
Jul 14, 2022
4744dcf
cleanup
Jul 18, 2022
1cdd513
preparing pull request
Jul 18, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -151,3 +151,7 @@ Session.vim
*~
# Auto-generated tag files
tags

# ignore png files in nb_models
nasbench301/nb_models
naslib/checkpoints
587 changes: 587 additions & 0 deletions examples/optimizers.ipynb

Large diffs are not rendered by default.

Loading