Ensemble - leemik3/tensorflow-2.0 GitHub Wiki

์•™์ƒ๋ธ” ๊ธฐ๋ฒ•์˜ ๋ฐฉ๋ฒ•

Voting

ํˆฌํ‘œ ๋ฐฉ์‹ - ๋‹ค๋ฅธ ์•Œ๊ณ ๋ฆฌ์ฆ˜ model์„ ์กฐํ•ฉํ•ด์„œ ์‚ฌ์šฉ

  1. hard vote : ๊ฒฐ๊ณผ๋ฌผ์— ๋Œ€ํ•œ ์ตœ์ข… ๊ฐ’์„ ํˆฌํ‘œ
  2. soft vote : ์ตœ์ข… ๊ฒฐ๊ณผ๋ฌผ์ด ๋‚˜์˜ฌ ํ™•๋ฅ  ๊ฐ’์„ ๋‹ค ๋”ํ•ด์„œ ์ตœ์ข… ๊ฒฐ๊ณผ๋ฌผ์— ๋Œ€ํ•œ ๊ฐ๊ฐ์˜ ํ™•๋ฅ ์„ ๊ตฌํ•˜์—ฌ ์ตœ์ข… ๊ฐ’ ๋„์ถœ. soft vote๊ฐ€ hard vote๋ณด๋‹ค ๋” ํ•ฉ๋ฆฌ์ ์ด๋ผ๋Š” ๊ฒƒ์ด ๋Œ€์„ธ

Bagging (Bootstrap Aggregating)

ํˆฌํ‘œ ๋ฐฉ์‹ - ๊ฐ™์€ ์•Œ๊ณ ๋ฆฌ์ฆ˜ ๋‚ด์—์„œ ๋‹ค๋ฅธ sample ์กฐํ•ฉ ์‚ฌ์šฉ

Boosting

Stacking

Average weighting

Reference

tistory