S3 Storage Guide - cloud-barista/cb-spider GitHub Wiki

1. CB-Spider S3 Storage ๊ฐœ์š”

  • CB-Spider๋Š” ๋ฉ€ํ‹ฐ ํด๋ผ์šฐ๋“œ Object Storage๋ฅผ AWS S3 ํ‘œ์ค€ ๋ฐฉ๋ฒ• ๋ฐ API๋ฅผ ์ด์šฉํ•˜์—ฌ ๋™์ผํ•œ ํ˜•์ƒ์œผ๋กœ ๊ด€๋ฆฌํ•  ์ˆ˜ ์žˆ๋‹ค.
  • ์‚ฌ์šฉ์ž๋Š” Bucket์„ ์ƒ์„ฑํ•˜๊ณ , ์ƒ์„ฑํ•œ Bucket์— Object(ํŒŒ์ผ)์„ ์œ ์ผํ•œ Key๋ฅผ ๋ถ€์—ฌํ•˜์—ฌ ์ €์žฅ ๋ฐ ๊ด€๋ฆฌํ•  ์ˆ˜ ์žˆ๋‹ค.
  • ์‚ฌ์šฉ์ž๋Š” ์—ฌ๋Ÿฌ ๊ฐœ์˜ Bucket์„ ์ƒ์„ฑ ๊ด€๋ฆฌํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ํ•˜๋‚˜์˜ Bucket์—๋Š” ์—ฌ๋Ÿฌ ๊ฐœ์˜ Key:Object๋ฅผ ์ €์žฅ ๊ด€๋ฆฌํ•  ์ˆ˜ ์žˆ๋‹ค.

image

2. CB-Spider S3 Storage ์„ค์ • (since v0.11.11)

  • CSP Console์—์„œ Object Storage ์‚ฌ์šฉ enable ๋ฐ ๊ถŒํ•œ ์„ค์ • ํ™•์ธ
  • CSP๋ณ„ Connection์˜ Credential ์ •๋ณด์— S3 ์ธ์ฆ ์ •๋ณด(HMAC key) ๋ฐœ๊ธ‰ ๋ฐ ์ถ”๊ฐ€ ์„ค์ • ํ•„์š”
    • ๊ธฐ์กด Credential๊ณผ ๋™์ผํ•˜์—ฌ S3 ์ธ์ฆ ์ถ”๊ฐ€ ๋ถˆํ•„์š”ํ•œ CSP

      [AWS/Alibaba/NCP]
      
    • ์ถ”์ƒํ™”๋œ ๋™์ผํ•œ Key Name์„ ํ™œ์šฉํ•œ ๋ฐฉ๋ฒ•

      [GCP/IBM/NHN/KT]
          ... ๊ธฐ์กด Credential ์ •๋ณด
          {"Key": "S3AccessKey", "Value": "***"},
          {"Key": "S3SecretKey", "Value": "***"}
      
    • CSP Web Console์ด ์ œ๊ณตํ•˜๋Š” Key Name์„ ์ง์ ‘ ํ™œ์šฉํ•œ ๋ฐฉ๋ฒ•

      [GCP]
          ... ๊ธฐ์กด Credential ์ •๋ณด
          {"Key": "Access Key", "Value": "***"},
          {"Key": "Secret", "Value": "***"}
      
      [IBM]
          ... ๊ธฐ์กด Credential ์ •๋ณด
          {"Key": "access_key_id", "Value": "***"},
          {"Key": "secret_access_key", "Value": "***"}
      
      [NHN/KT]
          ... ๊ธฐ์กด Credential ์ •๋ณด
          {"Key": "Access Key", "Value": "***"},
          {"Key": "Secret Key", "Value": "***"}
      

3. S3 Storage API ํ™œ์šฉ (since v0.11.6)


4. CB-Spider AdminWeb ํ™œ์šฉ

  • Connection ์„ ํƒ
  • S3 ๊ด€๋ฆฌ ํŽ˜์ด์ง€๋กœ ์ด๋™
  • S3 ๊ด€๋ฆฌ ์ฃผ์š” ๊ธฐ๋Šฅ์€ ๋‹ค์Œ๊ณผ ๊ฐ™๋‹ค
    • (1) Bucket ์ƒ์„ฑ
    • (2) ์ƒ์„ฑํ•œ Bucket ์ •๋ณด ์ œ๊ณต ๋ฐ ์„ ํƒ
    • (3) ์„ ํƒํ•œ Bucket์— Object ์ €์žฅ
    • (4) ์ €์žฅํ•œ Object ์ •๋ณด ์ œ๊ณต
    • (5) ์ €์žฅํ•œ Object ๋‹ค์šด๋กœ๋“œ
    • (6) ์ €์žฅํ•œ Object PreSigned URL ์ƒ์„ฑ
    • (7) ํ˜„์žฌ Bucket์˜ Object๋“ค์˜ Version ๊ด€๋ฆฌ ์ œ๊ณต ์—ฌ๋ถ€ ์„ ํƒ
    • (8) Versioning ์„ ํƒํ•œ Bucket์˜ ๊ฒฝ์šฐ Objecet๋“ค์— ๋Œ€ํ•œ Version ๊ด€๋ฆฌ
    • (9) ํ˜„์žฌ Bucket์˜ CORS ์„ค์ • ๋ฐ ์‚ญ์ œ
image

5. S3 Browser S3 ํƒ์ƒ‰ ๋„๊ตฌ ํ™œ์šฉ

  • ์„ค์น˜ ๋ฐ ์‚ฌ์šฉ ๋ฐฉ๋ฒ• ๋“ฑ์€ S3 Browser ์ฐธ๊ณ 
  • CB-Spider Account ์„ค์ • ๋ฐฉ๋ฒ•์€ ๋‹ค์Œ๊ณผ ๊ฐ™๋‹ค.
    • Account: S3 Compatible Storage ์„ ํƒ
    • API: localhost:1024 ์ž…๋ ฅ
    • Access Key: connection name ์ž…๋ ฅ
    • Secret Access: ์•„๋ฌดํ‚ค๋‚˜ ์ž…๋ ฅ
    • Use secure transfer (SSL/TLS): unCheck
image

โ€ป ์ฐธ๊ณ : AWS S3 Reference

โš ๏ธ **GitHub.com Fallback** โš ๏ธ