AI_SDXL_Mask_Test - 100-hours-a-week/16-Hot6-wiki GitHub Wiki

상위 문서로 이동 : AI Wiki

Issue 정리

  • 각 Object마다 Mask를 처리하면 어색한 문제

Solution

  • Object Mask를 부드럽게 처리하는 것이 아닌 각 Object Bounding box로 Mask 처리
Object Mask Bounding Box
clean_mask inpainting_background_mask-8

Result

Object Mask Bounding Box
inpainted_result-29_out inpainted_result_out-10

Other Test

Test 1 Test 2 Test 3
Origin resized_1024 resized_1024-2 resized_1024-3
Generated inpainted_result_out-7 inpainted_result_out-8 image
  • prompt = "a cozy and stylish desk setup with a potted plant, a sleek wireless charger, a modern desk clock, and a ceramic coffee cup placed naturally, warm ambient lighting, soft shadows, minimalist interior"
  • negative_prompt = "blurry, low quality, extra hands, extra monitors, text, logo, watermark, distorted, duplicate items, poorly drawn, bad anatomy, disfigured, overexposed, grainy, frame, cropped"

Next Step

  • BLIP 제거

    • Captioning은 Groundino 선에서 가능
    • Label과 Box 좌표 Prompt(GPT-4o에 전달)
  • Prompt 수정

    • Prompt에 좌표 넣어보기(e.g. (3, 4)가 모니터인데, 오른쪽에 선인장 넣어줘 등)
⚠️ **GitHub.com Fallback** ⚠️