Development reference and Contributor WANTED!! - cloud-barista/cb-spider GitHub Wiki

[AS-IS]

Basic

  • Go, Shell Script 등
  • struct, struct array, slice, map, strings
  • file io
  • reflect
  • goroutine
  • json handling: struct <-> json
  • yaml file handling: config file
  • ...

Spider Server

  • Rest Server: Echo framework
  • gRPC Server: gRPC Protobuf, gRPC Stub, GoGo, ...
  • Meta info: cb-store(Key-Value store common wrapper, etcd or nutsdb, ...) 활용
  • encryption/decryption: 주요 정보 암호화/복호화
  • Locking
  • logger: cb-log(Cloud-Barista logger) 활용

Cloud Drivers

  • Go Interface-Driver 개념 이해
  • CSP별 Go Client Pkg
  • plugin with Go shared library
  • Go Unit Test framework
  • Current drivers:

Spider Client

  • REST API
  • Go API(gRPC-based)
  • CLI(Go API-based)
  • AdminWeb(embedded web, REST): http, cgi, javascript

Spider Test

  • Go Unit Test framework
  • Github workflow

Spider Server run environments

  • Go module (go.mod)
  • Docker
  • Kubernetes
  • etcd
  • ...

Documentations

  • Markdown: readme, install guide, design, ...
  • PostMan: API Docs

[TO-BE]

Improve the current version

Edge/Distributed Spider

  • server election
  • heartbeat
  • distributed command control
  • ...

more Drivers

Documentations

  • Swagger: API Docs