Home - map-search/map-search-etl GitHub Wiki

Welcome to the map-search-etl wiki!

Kang-heesuk commented on Oct 5 โ€ข
์ฃผ์ œ : ์ง€๋„ ๊ฒ€์ƒ‰ ์‹ค์‹œ๊ฐ„ ํŠธ๋ Œ๋“œ
!๋ณธ ์ฃผ์ œ์˜ ์šฐ์ˆ˜์ฐธ๊ฐ€์ž๋กœ ์„ ์ •์‹œ 'NAVER'์—์„œ '์ฑ„์šฉ์ „ํ™˜ํ˜• ์ธํ„ด์‹ญ'์˜ ์ฐธ์—ฌ๊ธฐํšŒ๊ฐ€ ์ฃผ์–ด์ง‘๋‹ˆ๋‹ค.

์ฃผ์ œ์„ ์ • ๋ฐฐ๊ฒฝ
ํŠธ๋ Œ๋””ํ•œ, ์ด์Šˆํ™”๋œ, ์‹ค์‹œ๊ฐ„ ๋“ฑ์˜ ๊ฒ€์ƒ‰์„ ํ•˜๊ธฐ ์œ„ํ•ด์„  score์— ๊ธฐ๋ฐ˜ํ•œ rank ๋กœ์ง์ด runtime์—๋„ ํ•„์š”ํ•จ.
(์˜ˆ, Learning to Rank) prototype ์„ ๋งŒ๋“ค์–ด ๊ฐ€๋Šฅ์„ฑ์„ ๊ฒ€์ฆํ•œ๋‹ค.
๊ฐœ๋ฐœ ์š”๊ตฌ์‚ฌํ•ญ (ํ•„์ˆ˜)
spark๋ฅผ ์‚ฌ์šฉํ•ด์„œ ์ง€๋„ ๋ฐ์ดํ„ฐ๋ฅผ ์ •ํ˜•ํ™”๋œ ํฌ๋ฉง์œผ๋กœ ๋ณ€ํ™˜ ๋ฐ ์ €์žฅ
์ง€๋„ ๊ฒ€์ƒ‰ ๋žญํ‚น ๋ชจ๋ธ๋ง
์ง€๋„ ๊ฒ€์ƒ‰ ์„œ๋น„์Šค ๊ฐœ๋ฐœ
๋กœ๊ทธ ๊ธฐ๋ฐ˜, ๊ธ‰์ƒ์Šน ์ธ๊ธฐ ๊ฒ€์ƒ‰์–ด ๋ฐ ๊ธ‰์ƒ์Šน ์ธ๊ธฐ ์žฅ์†Œ ์ถ”์ถœ ๋ฐ display(kibana ์ด์šฉ)
๊ฐœ๋ฐœ ์š”๊ตฌ์‚ฌํ•ญ (์„ ํƒ)
์‹ค์‹œ๊ฐ„ ๋ฐ์ดํ„ฐ์˜ ์ง€๋„ ๊ฒ€์ƒ‰ ๋ชจ๋ธ ๋žญํ‚น ์ ์šฉ์„ ์œ„ํ•ด ES Learning to Rank ํ”Œ๋Ÿฌ๊ทธ์ธ ๊ฐœ๋ฐœ
์‹ค์‹œ๊ฐ„ ๋ฐ์ดํ„ฐ๊ฐ€ ๋žญํ‚น ๋ชจ๋ธ์ด ๋ฐ˜์˜๋œ ์ง€๋„ ๊ฒ€์ƒ‰ ์„œ๋น„์Šค ๊ฐœ๋ฐœ
๊ฐœ๋ฐœ์–ธ์–ด
kotlin(or java8), scala(or python)
ํ”Œ๋žซํผ
(serving) spring boot 2, (engine) elastic search 6.x, (etl) spark 2
๊ธฐํƒ€์‚ฌํ•ญ
๊ฐœ๋ฐœ ํ™˜๊ฒฝ : Macbook pro, intellij
raw data๊ฐ€ ๋˜๋Š” ์ง€๋„ ๋ฐ์ดํ„ฐ๋Š” ๋ฏธ๋ฆฌ text ํŒŒ์ผ๋กœ ์ œ๊ณตํ•จ
@Kang-heesuk Kang-heesuk added .NAVER .์ฑ„์šฉํ˜•์ธํ„ด์‹ญ JAVA kotlin scala labels on Oct 5
@Kang-heesuk Kang-heesuk closed this 16 days ago