Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mariogeiger authored Nov 14, 2019
1 parent 8a20719 commit e77a9b1
Showing 1 changed file with 15 additions and 5 deletions.
20 changes: 15 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,11 +1,20 @@
# feature and lazy learning
# Feature and lazy training

dependancies:
[article on arXiv](https://arxiv.org/abs/1906.08034)

## notation
The notations in the code does not match with the notation in the article,
- the scaling factor at the network's output is `alpha/h` in the code and `alpha/sqrt(h)` in the article
- the loss prefactor is `1/alpha` in the code and `1/alpha^2` in the article

it imply that `alpha_code = sqrt(h) alpha_article` and `t_code/h = t_article/(sqrt(h) alpha_article)`.

## dependancies
- pytorch
- github.com/mariogeiger/hessian
- github.com/mariogeiger/grid

examples:
## example
```
python -m grid F10k3Lsp_alpha --n 1 "python main.py --train_time 18000 --data_seed 0 --batch_seed 0 --init_kernel 0 --final_kernel 0 --delta_kernel 0 --arch fc_softplus --L 3 --dataset fashion --ptr 10000 --pte 50000 --tau_alpha_crit 1e3 --tau_over_h 1e-3" --init_seed 0 1 2 3 4 5 6 7 8 9 --alpha 1e-4 1e-2 1e0 1e2 1e4 1e6 --h:int 100 1000
```
Expand All @@ -15,6 +24,7 @@ how to read the output file:
from grid import load
runs = load('F10k3Lsp_alpha')

r = runs[0]
print(r['regular']['test']['outputs'])
for r in runs:
print(r['regular']['test']['outputs']) # display output of the testset
print(r['regular']['dynamics'][-1]['test']['err']) # display the final test error
```

0 comments on commit e77a9b1

Please sign in to comment.