Week13 Day5 - ai-esg/our-history GitHub Wiki

https://ecotrust-canada.github.io/markdown-toc/

ํŒ€ NLP 11์กฐ Week13 Day5

๋ชฉ์ฐจ

์ผ์ž

  • 2021.10.28 ๊ธˆ

ํŒ€์›

  • ๋ฌธ์„์•”_T2075
  • ๋ฐ•๋งˆ๋ฃจ์ฐฌ_T2078
  • ๋ฐ•์•„๋ฉ˜_T2090
  • ์šฐ์›์ง„_T2137
  • ์œค์˜ํ›ˆ_T2142
  • ์žฅ๋™๊ฑด_T2185
  • ํ™ํ˜„์Šน_T2250

์ฃผ๊ฐ„ ์ผ์ •

Retrieval ์„ฑ๋Šฅ

  • Sparse : top1 ~30
  • Elastic : top1 ~33

ํ•  ์ผ

  • topk ๋ฌธ์„œ ์ œ๊ณต ํ•  ๋•Œ, question, context 1:1 ๋งค์นญํ•ด์„œ ์ œ๊ณต

  • post processing ์กฐ์‚ฌ ์ œ๊ฑฐ

    • ๋๋ถ€๋ถ„๋งŒ. ์ค‘๊ฐ„์˜ ์กฐ์‚ฌ๋Š” ์œ ์ง€.
  • bm 25 (์žฅ๋™๊ฑด, ๋ฐ•์•„๋ฉ˜)

    • ์ €์žฅ, ์‹คํ–‰์‹œ๊ฐ„ ์ด์Šˆ ํ•ด๊ฒฐ

๋ฌธ์ œ

  • elastic search์—์„œ k๊ฐœ ๋งŒํผ์˜ ๋ฌธ์„œ๊ฐ€ ์ œ๊ณต๋˜์ง€ ์•Š๋Š” ์ผ€์ด์Šค

ํ”ผ์–ด์„ธ์…˜

  • inference dataset ๋„˜๊ฒจ์ฃผ๊ธฐ ์–‘์‹