Week9 Day3 - ai-esg/our-history GitHub Wiki
ν NLP 11μ‘° Week9 Day3
λͺ©μ°¨
μΌμ
- 2021.09.29 μ
νμ
- λ¬Έμμ_T2075
- λ°λ§λ£¨μ°¬_T2078
- λ°μλ©_T2090
- μ°μμ§_T2137
- μ€μν_T2142
- μ₯λ건_T2185
- ννμΉ_T2250
νΌμ΄μΈμ
TODO
-
wandb ν μ€νΈ
- λ¬Έμμ_T2075 β
- λ°λ§λ£¨μ°¬_T2078 β
- λ°μλ©_T2090 β
- μ°μμ§_T2137 β
- μ€μν_T2142 β
- μ₯λ건_T2185 β
- ννμΉ_T2250
-
train.py
- μ ν¬ λͺ¨λΈ class μ°κ²° (pre/custom λΆλ₯) β
- K-Foldλ‘ μ§νν μ§, K-Foldλ₯Ό μ΄μ©νμ§ μκ³ μ§νν μ§ μ¬λΆ μ
λ ₯νλ argparse νμ.
- νΉμ 2κ°μ μ μμ λν΄ k -> train set : dev set = k-1 : 1μ΄ λλλ‘. default 5.
- iteration_number -> 1μΌ κ²½μ° k-foldκ° μλ μ . kλ³΄λ€ μκ±°λ κ°μ μ μ. default 1.
- validation set λΆν λΉμ¨ μ λ ₯ν argparse
- --fullname blabla λ무 κΉλλ€. -f XXμ²λΌ μ§§μμ΄λ¦ μΆκ°κ° μκΈν©λλ€.β
-
μ€ν
- roberta-base
- roberta-large
- roberta-small
- config μμ
- return_token_type_ids=False μΆκ° νμ
- bert-base val ν
μ€νΈ
- submit val test score μ°¨μ΄
ν μ λ΄μ©
branch
- λ무 λ§μμ μ΄κ±Έ ν©μΉκ³ μ§μΈμ§ λ§μ§
- μΆν κ²°μ
train.py arg λ¬Έμν
- help μ‘΄μ¬λ‘ μΈν λΆνμ
- μ΄ν νμμ λλ λ¬Έμνκ° λ νμν κ²½μ° μΆκ°
wandb 컨밴μ
νλͺ©
- λ μ§
- model
- k-fold
- 8:2(val)
- tokenizer
- isPre
μμ
09/29_klue/bert-base_k-fold_8:2_XXX_isPre
git 컨밴μ
Commit
- prefix
- add
- feat
- fix
- refactor
- chore
- docs
[type(prefix)] : title
[feat] : title
- λ΄μ©
Issue
- μ λͺ©
- κΈ°λ₯μ΄λ¦
## μ΄μ λ΄μ©
- ν΄λΉ λ΄μ©
## μμ
λ΄μ©
-
## μ£Όμ μ¬ν
-
PR
- μ λͺ©
- λ΄μ©
## μμ
λ΄μ©
-
## μ£Όμ λ‘μ§
-
## μ€ν¬λ¦°μ· (νμμ)
-
## κ΄λ ¨ μ΄μ ex) Close #1 (μ΄λλ‘ ν΄μΌ λͺ
λ Ήμ΄ μΈμλ©λλ€.)
Close