Meeting Agenda and Notes - fluid-cloudnative/community GitHub Wiki

Community Meeting Minutes

2024/03/28

Topic:

  • Practice of accelerating large model deployment based on Fluid+KServe
  1. Introduction to Background
  2. Introducing how to accelerate large model deployment based on Fluid+KServe

Speaker:

  • @蔡礼泽

Attendees:

  • @顾荣
  • @车漾
  • @蔡礼泽
  • @许之浩
  • @仇伶玮
  • @普渡
  • @吴牧然
  • @张晓铮
  • @鲍文杰
  • @王问骁
  • @汪序
  • @Lize
  • @琦彦
  • @顾静
  • @代镇聪
  • @杨瑞璋
  • @刘栗荣
  • @陈启明
  • @黄旭
  • @李思勉
  • @刘非凡
  • @李宇航

Minutes:

Practice of accelerating large model deployment based on Fluid+KServe

  1. Introduction to Background
  2. Introducing how to accelerate large model deployment based on Fluid+KServe

Video Records:

2024/03/14

Topic:

  • How to use Fluid in Kubeflow Pipelines
  1. Introduction to Background
  2. Introducing how to use Fluid in Kubeflow Pipelines
  3. Demo

Speaker:

  • @张晓铮

Attendees:

  • @顾荣
  • @车漾
  • @普渡
  • @许之浩
  • @刘志强
  • @姜浩
  • @张晓铮
  • @鲍文杰
  • @王问骁
  • @汪序
  • @夏志刚
  • @Lee
  • @姚坤
  • @阿宇
  • @扬礼
  • @刘栗荣
  • @陈启明

Minutes:

How to use Fluid in Kubeflow Pipelines

  1. Introduction to Background
  2. Introducing how to use Fluid in Kubeflow Pipelines
  3. Demo

Video Records:

2024/02/29

Topic:

  • Fluid+JindoCache based practice for accelerating large model training
  1. Introduction to Background
  2. Introduction to the efficient cache scheduling acceleration system

Speaker:

  • @求索

Attendees:

  • @顾荣
  • @车漾
  • @求索
  • @许之浩
  • @姜浩
  • @张晓铮
  • @鲍文杰
  • @王问骁
  • @汪序
  • @金志敏
  • @fangke
  • @田子杰

Minutes:

Fluid+JindoCache based practice for accelerating large model training

  1. Introduction to Background
  2. Introduction to the efficient cache scheduling acceleration system

Video Records:

2024/01/18

Topic:

Use vineyard to accelerate kubeflow pipelines in the fluid platform

  1. Introduction to Vineyard
  2. Demo

Speaker:

  • @曹野

Attendees:

  • @车漾
  • @曹野
  • @刘志强
  • @许之浩
  • @张晓铮
  • @鲍文杰
  • @王问骁
  • @汪序
  • @何涛
  • @赵汉宇

Minutes:

Use vineyard to accelerate kubeflow pipelines in the fluid platform

  1. Introduction to Vineyard
  2. Demo

Video Records:

2023/12/28

Topic:

Fluid ThinRuntime supports GlusterFS

  1. Introduction to Fluid
  2. Introduction to GlusterFS
  3. Demo

Speaker:

  • @安培

Attendees:

  • @顾荣
  • @安培
  • @许之浩
  • @张晓铮
  • @鲍文杰
  • @陈启明
  • @王问骁
  • @李宇航
  • @黄旭
  • @汪序
  • @王书麟
  • @李思勉

Minutes:

Fluid ThinRuntime supports GlusterFS

  1. Introduction to Fluid
  2. Introduction to GlusterFS
  3. Demo

Video Records:

2023/12/14

Topic:

Fluid Cache Design

  1. cache replicas adaptive adjustment
  2. application soft affinity mechanism

Speaker:

  • @顾荣

Attendees:

  • @顾荣
  • @车漾
  • @刘志强
  • @张晓铮
  • @鲍文杰
  • @陈启明
  • @王问骁
  • @李宇航
  • @黄旭
  • @汪序
  • @王书麟
  • @李思勉
  • @代镇聪
  • @吴牧然

Minutes:

Fluid Cache Design

  1. cache replicas adaptive adjustment
  2. application soft affinity mechanism

Video Records:

2023/11/09

Topic:

Vineyard Runtime Design

  1. Background
  2. Integrate with fluid

Speaker:

  • @曹野

Attendees:

  • @顾荣
  • @车漾
  • @徐之浩
  • @张晓铮
  • @鲍文杰
  • @陈启明
  • @王问骁
  • @Changwei Ge
  • @杨嘉奇
  • @石丁
  • @刘志强

Minutes:

Vineyard Runtime Design

  1. Background
  2. Integrate with fluid

Video Records:

Attachments:

2023/10/19

Topic:

Application Practice of Fluid on Huawei NAIE Training Platform

  1. Scene
  2. Demand
  3. Reason for choosing Fluid
  4. NAIE Integrated Fluid Data Cache Architecture Diagram
  5. NAIE tuning for large number of small file scenarios
  6. Business effectiveness
  7. Outlook for the future

Speaker:

  • @吴世明

Attendees:

  • @顾荣
  • @徐之浩
  • @王书麟
  • @陈启明
  • @张晓铮
  • @王问骁
  • @鲍文杰
  • @杨东
  • @黄旭
  • @别路
  • @陆地浅水鱼
  • @刘克
  • @高云

Minutes:

Application Practice of Fluid on Huawei NAIE Training Platform

  1. Scene
  2. Demand
  3. Reason for choosing Fluid
  4. NAIE Integrated Fluid Data Cache Architecture Diagram
  5. NAIE tuning for large number of small file scenarios
  6. Business effectiveness
  7. Outlook for the future

2023/09/14

Topic:

Fluid's Practice Case Sharing on Xiaomi's Machine Learning Platform

  1. Background
  2. Technology selection: Serverless containers in hybrid cloud
  3. Technical challenges of using serverless containers in a hybrid cloud
  4. Solution: ACK Fluid opens up data access in hybrid cloud
  5. Procedure
  6. Result benefits
  7. Outlook for the future

Speaker:

  • @何逸凡

Attendees:

  • @顾荣
  • @徐之浩
  • @宋凌逸
  • @李宇航
  • @刘非凡
  • @鲍文杰
  • @陈启明
  • @李翰
  • @张晓铮
  • @王问骁
  • @echo
  • @张哲宇
  • @吴牧辞
  • @仇伶玮
  • @Little-Prince
  • @lucx
  • @竺皓
  • @陆地浅水鱼

Minutes:

Fluid's Practice Case Sharing on Xiaomi's Machine Learning Platform

  1. Background
  2. Technology selection: Serverless containers in hybrid cloud
  3. Technical challenges of using serverless containers in a hybrid cloud
  4. Solution: ACK Fluid opens up data access in hybrid cloud
  5. Procedure
  6. Result benefits
  7. Outlook for the future

Video Records:

Attachments:

2023/08/31

Topic:

Practical Application of Cloud Native Storage CubeFS and Fluid

  1. Introduction to Fluid
  2. Introduction to CubeFS
  3. Demo

Speaker:

  • @龚名威

Attendees:

  • @顾荣
  • @宋凌逸
  • @李宇航
  • @刘非凡
  • @鲍文杰
  • @陈启明
  • @李翰
  • @王书麟
  • @张晓铮
  • @王问骁
  • @Freesia昼河猫
  • @WilliamGong

Minutes:

Practical Application of Cloud Native Storage CubeFS and Fluid

  1. Introduction to Fluid
  2. Introduction to CubeFS
  3. Demo

Video Records:

Attachments:

2023/08/17

Topic:

Development Process and Demo for Fluid ThinRuntime

  1. Introduction
  2. Write parameter parsing script
  3. Create FUSE container image
  4. Develop and deploy ThinRuntimeProfile for MiniIO
  5. Demo

Speaker:

  • @王书麟

Attendees:

  • @顾荣
  • @徐之浩
  • @王问骁
  • @张晓铮
  • @鲍文杰
  • @陈启明
  • @吴世明

Minutes:

Development Process and Demo for Fluid ThinRuntime

  1. Introduction
  2. Write parameter parsing script
  3. Create FUSE container image
  4. Develop and deploy ThinRuntimeProfile for MiniIO
  5. Demo

Video Records:

Attachments:

2023/08/01

Topic:

Work Sharing on Elastic Cache Capacity Configuration Research

  1. Introduction
  2. Design of Cuki
  3. Concurrency Control in Cuki
  4. Cache Capacity Online Tuning Using Cuki
  5. Evaluation

Speaker:

  • @顾荣

Attendees:

  • @车漾
  • @徐之浩
  • @王问骁
  • @张晓铮
  • @刘志强
  • @鲍文杰
  • @陈启明
  • @李先发
  • @王书麟
  • @王成龙

Minutes:

Work Sharing on Elastic Cache Capacity Configuration Research

  1. Introduction
  2. Design of Cuki
  3. Concurrency Control in Cuki
  4. Cache Capacity Online Tuning Using Cuki
  5. Evaluation

Video Records:

Attachments:

2023/07/20

Topic:

Design of DataProcess operations and DataFlow

  1. Overview
  2. Design principles
  3. API design
  4. Architecture design
  5. Component workflow

Speaker:

  • @徐之浩

Attendees:

  • @顾荣
  • @wenxiaowang
  • @张晓铮
  • @刘志强
  • @weiwei
  • @车漾
  • @鲍文杰
  • @陈启明
  • @李国玉
  • @王书麟
  • @顾树威
  • @王兴瑞
  • @胡安
  • @石丁

Minutes:

Design of DataProcess operations and DataFlow

  1. Overview
  2. Design principles
  3. API design
  4. Architecture design
  5. Component workflow

Video Records:

Attachments:

2023/07/06

Topic:

Fluid 1.0.0 Development Plan

  1. Fluid 1.0.0 Development Goals
  2. Fluid 1.0.0 Development Theme
  3. Fluid 1.0.0 Development Plan
  4. Fluid 1.0.0 Development Requirements

Speaker:

  • @车漾

Attendees:

  • @顾荣
  • @wenxiaowang
  • @陈启明
  • @张晓铮
  • @刘志强
  • @weiwei

Minutes:

Fluid 1.0.0 Development Plan

  1. Fluid 1.0.0 Development Goals
  2. Fluid 1.0.0 Development Theme
  3. Fluid 1.0.0 Development Plan
  4. Fluid 1.0.0 Development Requirements

Video Records:

Attachments:

2023/06/20

Topic:

An Introduction to Fluid-0.9

  1. Introduction to Fluid-0.9
  2. Introduction to ThinRuntime
  3. Data Sharing across Namespace
  4. Introduction to EFCRuntime
  5. Others

Speaker:

  • @顾荣

Attendees:

  • @车漾
  • @徐之浩
  • @陈启明
  • @wenxiaowang
  • @鲍文杰
  • @王书麟
  • @张晓铮
  • @刘志强
  • @仇伶玮
  • @竺皓

Minutes:

An Introduction to Fluid-0.9

  1. Introduction to Fluid-0.9
  2. Introduction to ThinRuntime
  3. Data Sharing across Namespace
  4. Introduction to EFCRuntime
  5. Others

Video Records:

Attachments:

2023/05/25

Topic:

An Introduction to Fluid EFCRuntime

  1. Introduction to EFC
  2. Introduction to EFCRuntime
  3. How to use EFCRuntime

Speaker:

  • @展逸

Attendees:

  • @车漾
  • @徐之浩
  • @陈启明
  • @wenxiaowang
  • @鲍文杰
  • @王书麟
  • @Changwei Ge
  • @薛圣杰

Minutes:

  1. Introduction to EFC
  2. Introduction to EFCRuntime
  3. How to use EFCRuntime

Video Records:

Attachments:

2023/03/16

Topic:

Take Presto as an example to introduce Fluid DataTable

  1. Background Introduction
  2. Conceptual Design
  3. Use Example
  4. Conclusion

Speaker:

  • @wenxiaowang
  • @顾荣

Attendees:

  • @顾荣
  • @Ma Hao
  • @wenxiaowang
  • @仇伶玮
  • @鲍文杰

Minutes:

  1. Background Introduction
  2. Conceptual Design
  3. Use Example
  4. Conclusion

Video Records:

Attachments:

2023/03/02

Topic:

Fluid DataMigrate Supports Data Migration Design

  1. Background Introduction
  2. Key design and implementation
  3. Demo

Speaker:

  • @weiwei

Attendees:

  • @顾荣
  • @cheyang
  • @仇伶玮
  • @weiwei
  • @徐之浩
  • @wenxiaowang
  • @鲍文杰
  • @王书麟
  • @zhangxiaozheng
  • @fsl
  • @zhangxingji

Minutes:

  1. Background Introduction
  2. Key design and implementation
  3. Demo

Video Records:

Attachments:

2023/02/16

Topic:

The framework design of Fluid to Accelerate the big data query on the cloud

  1. Background Introduction
  2. Requirement Analysis
  3. DataTable Design
  4. Future Planning

Speaker:

  • @顾荣

Attendees:

  • @顾荣
  • @cheyang
  • @仇伶玮
  • @徐之浩
  • @wenxiaowang
  • @陈国旺
  • @鲍文杰
  • @王书麟

Minutes:

  1. Background Introduction
  2. Requirement Analysis
  3. DataTable Design
  4. Future Planning

Video Records:

Attachments:

2023/01/12

Topic:

Fluid JindoRuntime New Feature Sharing

  1. JindoRuntime supports PVC mounting
  2. JindoRuntime performance optimization
  3. JindoFSx 5.0 Planning

Speaker:

  • @frank

Attendees:

  • @顾荣
  • @cheyang
  • @ChenQiming
  • @徐之浩
  • @wenxiaowang
  • @陈国旺
  • @鲍文杰
  • @Lize
  • @王书麟

Minutes:

  1. JindoRuntime supports PVC mounting
  2. JindoRuntime performance optimization
  3. JindoFSx 5.0 Planning

Video Records:

Attachments:

2022/12/22

Topic:

Alloxio 2.9 new feature Sharing

  1. Background Introduction
  2. Page Cache
  3. Metadata Cache
  4. Fuse

Speaker:

  • @Shawn Sun

Attendees:

  • @顾荣
  • @cheyang
  • @ChenQiming
  • @徐之浩
  • @wenxiaowang
  • @ZhangXiaozhen
  • @仇伶玮
  • @陈国旺
  • @鲍文杰

Minutes:

  1. Background Introduction
  2. Page Cache
  3. Metadata Cache
  4. Fuse

Video Records:

Attachments:

2022/12/08

Topic:

Cross Namespace Dataset Sharing

  1. Background Introduction
  2. Design Principles
  3. Detailed Design
  4. Demo

Speaker:

  • @顾荣

Attendees:

  • @顾荣
  • @cheyang
  • @ChenQiming
  • @Ma Hao
  • @徐之浩
  • @wenxiaowang
  • @ZhangXiaozhen
  • @仇伶玮
  • @陈国旺
  • @鲍文杰

Minutes:

  1. Background Introduction
  2. Design Principles
  3. Detailed Design
  4. Demo

Video Records:

Attachments:

2022/11/24

Topic:

Data Set Operation Reconstruction Design

  1. Background Introduction
  2. Existing Problems
  3. Architecture Planning
  4. Detailed Design

Speaker:

  • @cheyang
  • @顾荣
  • @仇伶玮

Attendees:

  • @顾荣
  • @cheyang
  • @ChenQiming
  • @frank
  • @Ma Hao
  • @徐之浩
  • @wenxiaowang
  • @ZhangXiaozhen
  • @仇伶玮
  • @汪序
  • @陈国旺
  • @鲍文杰

Minutes:

  1. Background Introduction
  2. Existing Problems
  3. Architecture Planning
  4. Detailed Design

Video Records:

Attachments:

2022/11/10

Topic:

Fluid 0.9 ThinRuntime

  1. Brief Introduction
  2. Design Principle
  3. Demo

Speaker:

  • @cheyang
  • @顾荣
  • @徐之浩

Attendees:

  • @顾荣
  • @cheyang
  • @ChenQiming
  • @hongchen
  • @suiyongxi
  • @徐之浩
  • @wenxiaowang
  • @ZhangXiaozhen
  • @仇伶玮
  • @张晓铮
  • @汪序
  • @陈国旺
  • @鲍文杰

Minutes:

  1. Brief Introduction
  2. Design Principle
  3. Demo

Video Records:

Attachments:

2022/10/20

Topic:

Fluid 0.9 Roadmap

  1. Brief Introduction
  2. Value Judgments and Strategies
  3. Theme and Plan
  4. Requirements and Product Capability

Speaker:

  • @cheyang
  • @顾荣

Attendees:

  • @顾荣
  • @cheyang
  • @ChenQiming
  • @hongchen
  • @suiyongxi
  • @徐之浩
  • @wenxiaowang
  • @ZhangXiaozhen
  • @仇伶玮
  • @李强林
  • @汪序
  • @陈国旺
  • @鲍文杰

Minutes:

  1. Brief Introduction
  2. Value Judgments and Strategies
  3. Theme and Plan
  4. Requirements and Product Capability

Video Records:

Attachments:

2022/09/29

Topic:

Fluid 0.8 Release Notes

  1. Release Notes
  2. Discussion

Speaker:

  • @顾荣

Attendees:

  • @顾荣
  • @cheyang
  • @840 7028 7987
  • @Joesong
  • @徐之浩
  • @wangshulin
  • @wenxiaowang
  • @汪序
  • @陈国旺
  • @鲍文杰

Minutes:

  1. Release Notes
  2. Discussion

Video Records:

Attachments:

2022/09/08

Topic:

Fluid in ML Model Serving

  1. What is SAP AI Core
  2. Challenges in ML Model Serving
  3. Fluid on Model Artifact Caching
  4. Result and Feedback

Speaker:

  • @LIZE CAI
  • @顾荣

Attendees:

  • @顾荣
  • @cheyang
  • @徐之浩
  • @kobe
  • @wangshulin
  • @zhanghaoran
  • @wenxiaowang
  • @ZK
  • @汪序
  • @zyb-xcx
  • @杨瑞璋
  • @陈国旺
  • @鲍文杰

Minutes:

  1. What is SAP AI Core
  2. Challenges in ML Model Serving
  3. Fluid on Model Artifact Caching
  4. Result and Feedback

Video Records:

Attachments:

2022/08/25

Topic:

Fluid accelerates Alibaba Cloud ECI

  1. Alibaba Cloud Container Service Product Family
  2. Background of serverless/ECI docking with fluid
  3. Brief introduction of Fluid on ECI
  4. Discussion

Speaker:

  • @景奇
  • @车漾

Attendees:

  • @车漾
  • @cheyang
  • @徐之浩
  • @dexter
  • @jingcheng sha
  • @Lei Li
  • @wenxiaowang
  • @wht13
  • @汪序

Minutes:

  1. Alibaba Cloud Container Service Product Family
  2. Background of serverless/ECI docking with fluid
  3. Brief introduction of Fluid on ECI
  4. Discussion

Video Records:

Attachments:

2022/08/04

Topic:

How to customize runtime in Fluid

  1. How Fluid works
  2. Lifecycle of dataset and runtime
  3. How to customize runtime
  4. Discussion

Speaker:

  • @weiwei
  • @顾荣

Attendees:

  • @顾荣
  • @cheyang
  • @徐之浩
  • @laoji
  • @陈国旺
  • @zhenghuai
  • @shugang
  • @mayyingchun
  • @wenxiaowang

Minutes:

  1. How Fluid works
  2. Lifecycle of dataset and runtime
  3. How to customize runtime
  4. Discussion

Video Records:

Attachments:

2022/06/23

Topic:

Fluid + JindoFSx 4.4.0 New Features Sharing

  1. Introduction of JindoFSx 4.4.0
  2. Fluid + JindoFSx 4.4.0
  3. Discussion

Speaker:

  • @扬礼
  • @顾荣

Attendees:

  • @顾荣
  • @cheyang
  • @徐之浩
  • @刘志强
  • @陈国旺
  • @扬礼
  • @眭永熙

Minutes:

  1. Introduction of JindoFSx 4.4.0
  2. Fluid + JindoFSx 4.4.0
  3. Discussion

Video Records:

Attachments:

2022/06/09

Topic:

Fluid: Dataset Abstraction and Elastic Acceleration for Cloud-native Deep Learning Training Jobs

  1. Motivation
  2. Challenges
  3. Fluid: Design and Mechanisms
  4. Evaluation
  5. Contributions and Discussions

Speaker:

  • @顾荣

Attendees:

  • @顾荣
  • @cheyang
  • @Jackie
  • @xingji
  • @仇伶玮
  • @陈国旺
  • @徐之浩
  • @扬礼

Minutes:

  1. Motivation
  2. Challenges
  3. Fluid: Design and Mechanisms
  4. Evaluation
  5. Contributions and Discussions

Video Records:

2022/05/26

Topic:

A Preliminary Exploration of Fluid Accelerated Big Data Query Framework on Kubernetes

  1. Background technology introduction
  2. Program analysis and discussion
  3. Preliminary designs
  4. Future planning outlook

Speaker:

  • @顾荣

Attendees:

  • @顾荣
  • @cheyang
  • @chenqiming
  • @HuayiChai
  • @yilun.fyl
  • @仇伶玮
  • @眭永熙
  • @陈国旺
  • @徐之浩
  • @汪序
  • @王书麟

Minutes:

  1. Background technology introduction
  2. Program analysis and discussion
  3. Preliminary designs
  4. Future planning outlook

Attachments:

Video Records:

2022/05/12

Topic:

Fluid Support Serverless Offline Task Lifecycle Management Design and Demonstration

  1. Introduction
  2. Design and Implementation
  3. Discussion

Speaker:

  • @weiwei
  • @顾荣

Attendees:

  • @weiwei
  • @顾荣
  • @晓鹏
  • @chenqiming
  • @HuayiChai
  • @Lize Cai
  • @wenxiaowang
  • @鲍文杰
  • @仇伶玮
  • @Haipeng Dai
  • @李瀚
  • @眭永熙
  • @陈国旺
  • @徐之浩
  • @汪序
  • @王书麟

Minutes:

  1. Introduction
  2. Design and Implementation
  3. Discussion

Attachments:

Video Records:

2022/04/28

Topic:

Cache Runtime Support Container Network

  1. Introduction
  2. Design and Implementation
  3. Discussion

Speaker:

  • @Ma Hao
  • @顾荣

Attendees:

  • @Ma Hao
  • @顾荣
  • @cheyang
  • @HuayiChai
  • @Lize Cai
  • @pangshaoliang
  • @wenxiaowang
  • @仇伶玮
  • @眭永熙
  • @陈国旺
  • @徐之浩

Minutes:

  1. Introduction
  2. Design and Implementation
  3. Discussion

Attachments:

Video Records:

2022/04/14

Topic:

Fluid practise with OpenYurt

  1. Introduction to OpenYurt
  2. OpenYurt + Fluid
  3. Discussion

Speaker:

  • @熊峰
  • @顾荣

Attendees:

  • @熊峰
  • @顾荣
  • @Haipeng Dai
  • @Chuangwei Lin
  • @cqm
  • @HuayiChai
  • @J.Z.
  • @Lize Cai
  • @WDE
  • @wenchao
  • @Yuanshun Huang
  • @Yuben Qu
  • @陈国旺
  • @仇伶玮
  • @徐之浩
  • @眭永熙
  • @汪序
  • @沈悦

Minutes:

  1. Introduction to OpenYurt
  2. OpenYurt + Fluid
  3. Discussion

Attachments:

Video Records:

2022/03/31

Topic:

Fluid Practise in Bilibili

  1. Bilibili EasyAI
  2. Alluxio Meets EasyAI
  3. Best Practise
  4. Alluxio Perf

Speaker:

  • @Lei Li
  • @顾荣

Attendees:

  • @Lei Li
  • @顾荣
  • @纪坤宏
  • @林佳南
  • @眭永熙
  • @汪序
  • @王琪玮
  • @chenyuquan
  • @cheyang
  • @cqm
  • @Haipeng Dai
  • @liuke
  • @nizifan
  • @仇伶玮
  • @徐之浩

Minutes:

  1. Bilibili EasyAI
  2. Alluxio Meets EasyAI
  3. Best Practise
  4. Alluxio Perf

Attachments:

Video Records:

2022/03/17

Topic:

Fluid 0.8 Roadmap

  1. Introduction to Fluid
  2. Key capability of Fluid
  3. Fluid 0.8 feature plan

Speaker:

  • @车漾
  • @顾荣

Attendees:

  • @车漾
  • @顾荣
  • @Baolong Mao
  • @chenyuquan
  • @cqm
  • @Haipeng Dai
  • @Huayi Chai
  • @Lei Li
  • @Lize
  • @Ma Hao
  • @smile
  • @yaolongliu
  • @陈国旺
  • @仇伶玮
  • @徐之浩

Minutes:

  1. Introduction to Fluid
  2. Key capability of Fluid
  3. Fluid 0.8 feature plan

Attachments:

Video Records:

2022/03/03

Topic:

Fluid 0.7 Release Notes

  1. Release Notes
  2. Discussion

Speaker:

  • @徐之浩

Attendees:

  • @徐之浩
  • @cheyang
  • @Lei Li
  • @miaojianwei
  • @nizifan
  • @weiwei zhu
  • @陈国旺
  • @仇伶玮
  • @眭永熙
  • @扬礼
  • @yaolongliu

Minutes:

  1. Release Notes
  2. Discussion

Video Records:

2022/02/16

Topic:

Recent Work on Alluxio Fuse

  1. New features
  2. Stability Improvements
  3. Performance Improvement
  4. Discussion

Speaker:

  • @顾荣
  • @Shawn Sun

Attendees:

  • @顾荣
  • @Shawn Sun
  • @anderson
  • @Bin fan
  • @chenyuquan
  • @cheyang
  • @Ethan Gao
  • @Lei li
  • @Lize
  • @Ma hao
  • @nizifan
  • @yaolongliu
  • @zhipeng.tzp
  • @柴华溢
  • @陈国旺
  • @戴海鹏
  • @李思勉
  • @吕冬冬
  • @宋凌逸
  • @王书麟
  • @谢远东
  • @仇伶玮
  • @徐之浩
  • @杨瑞璋
  • @张晓铮

Minutes:

  1. New features
  2. Stability Improvements
  3. Performance Improvement
  4. Discussion

Attachments:

Video Records:

2022/01/20

Topic:

Design Proposal for Fuse Recovery Feature

  1. Background
  2. Architecture design
  3. Workflow design
  4. Feature Demo

Speaker:

  • @顾荣
  • @weiwei

Attendees:

  • @顾荣
  • @weiwei
  • @车漾
  • @glove747
  • @Shuoran Liu
  • @shyodx
  • @xuchun li
  • @yaolongliu
  • @戴海鹏
  • @胡炜财
  • @谢远东
  • @nizifan
  • @张妙成
  • @张星基
  • @仇伶玮
  • @徐之浩
  • @陈国旺

Minutes:

  1. Background
  2. Architecture design
  3. Workflow design
  4. Feature Demo

Attachments:

Video Records:

2022/01/06

Topic:

Practise with AnalyticDB

  1. Background
  2. Architecture design
  3. Discussion

Speaker:

  • @顾荣
  • @道民

Attendees:

  • @顾荣
  • @道民
  • @车漾
  • @谢远东
  • @nizifan
  • @wanghuilong
  • @张星基
  • @仇伶玮
  • @徐之浩
  • @陈国旺

Minutes:

  1. Background
  2. Architecture design
  3. Discussion

Attachments:

Video Records:

2021/12/23

Topic:

Discussion about Fluid Agent

  1. Background and goals
  2. Architecture design
  3. Fluid Agent Design

Speaker:

  • @顾荣
  • @徐之浩

Attendees:

  • @顾荣
  • @徐之浩
  • @戴海鹏
  • @扬礼
  • @黎磊
  • @谢远东
  • @吕东东
  • @仇伶玮
  • @陈国旺

Minutes:

  1. Background and goals
  2. Architecture design
  3. Fluid Agent Design

Attachments:

Video Records:

2021/12/09

Topic:

Fluid practise in Weibo

  1. Background and Goals
  2. Best practise in Weibo

Speaker:

  • @顾荣
  • @wutong6

Attendees:

  • @顾荣
  • @wutong6
  • @车漾
  • @扬礼
  • @仇伶玮
  • @谢远东
  • @徐之浩
  • @陈国旺

Minutes:

  1. Background and Goals
  2. Best practise in Weibo

Video Records:

2021/11/25

Topic:

Support Fluid with Serverless

  1. Background and Goals
  2. Design and Implementation
  3. Workflow

Speaker:

  • @顾荣
  • @黎磊

Attendees:

  • @顾荣
  • @黎磊
  • @车漾
  • @马浩
  • @扬礼
  • @仇伶玮
  • @谢远东
  • @徐之浩
  • @陈国旺
  • @weiwei
  • @yaolongliu
  • @nizifan

Minutes:

  1. Background and Goals
  2. Design and Implementation
  3. Workflow

Attachments:

Video Records:

2021/11/11

Topic:

Add JuiceFSRuntime Engine To Fluid Backend

  1. Introduction to JuiceFS
  2. Design about JuiceFSRuntime
  3. Demo
  4. Future Work

Speaker:

  • @车漾
  • @吕东东

Attendees:

  • @车漾
  • @吕东东
  • @仇伶玮
  • @马浩
  • @扬礼
  • @徐之浩
  • @陈国旺
  • @weiwei
  • @davies
  • @nizifan
  • @Changjian Gao

Minutes:

  1. Introduction to JuiceFS
  2. Design about JuiceFSRuntime
  3. Demo
  4. Future Work

Attachments:

Video Records:

2021/10/27

Topic:

Plan Discussion for BigData App Integration

  1. Background
  2. Issues about current implementation
  3. Optimization plan

Speaker:

  • @顾荣
  • @仇伶玮

Attendees:

  • @顾荣
  • @仇伶玮
  • @谢远东
  • @徐之浩
  • @扬礼
  • @马浩
  • @黎磊
  • @朱唯唯
  • @陈国旺
  • @umialpha
  • @子凡

Minutes:

  1. Background
  2. Issues about current implementation
  3. Optimization plan

Attachments:

Video Records:

2021/10/13

Topic:

Open Discussion about Fluid

Speaker:

  • @顾荣

Attendees:

  • @顾荣
  • @扬礼
  • @马浩
  • @徐之浩
  • @陈国旺
  • @仇伶玮

Minutes:

  1. Open Discussion about Fluid

Video Records:

2021/09/23

Topic:

Introduction of Fluid JindoRuntime

  1. Introduction of JindoFS
  2. Implementation and the feature of Fluid JindoRuntime
  3. Cases about Fluid JindoRuntime

Speaker:

  • @顾荣
  • @扬礼

Attendees:

  • @顾荣
  • @车漾
  • @谢远东
  • @徐之浩
  • @扬礼
  • @朱唯唯
  • @吕东东
  • @陈国旺

Minutes:

  1. Introduction of JindoFS
  2. Implementation and the feature of Fluid JindoRuntime
  3. Cases about Fluid JindoRuntime

Attachments:

Video Records:

2021/09/08

Topic:

Fluid v0.7.0 Overview

  1. Fluid Theme
  2. v0.7.0 Overview
  3. Feature details and
  4. System architecture
  5. Discussion

Speaker:

  • @顾荣
  • @车漾

Attendees:

  • @顾荣
  • @车漾
  • @谢远东
  • @徐之浩
  • @仇伶玮
  • @朱唯唯
  • @马浩
  • @吕东东
  • @陈国旺
  • @李思勉

Minutes:

  1. Fluid Theme
  2. v0.7.0 Overview
  3. Feature details and
  4. System architecture
  5. Discussion

Attachments:

Video Records:

2021/08/25

Topic:

Discussion about the design of fuse lazy start and CSI Plugin refactoring

  1. Current workflow of the CSI Plugin in Fluid
  2. Design of refactored workflow of the CSI Plugin
  3. Discussion

Speaker:

  • @顾荣
  • @徐之浩

Attendees:

  • @顾荣
  • @车漾
  • @谢远东
  • @徐之浩
  • @仇伶玮
  • @朱唯唯
  • @马浩
  • @wutong6
  • @周佩洁
  • @陈国旺

Minutes:

  1. Current workflow of the CSI Plugin in Fluid
  2. Design of refactored workflow of the CSI Plugin
  3. Discussion

Attachments:

Video Records:

2021/08/11

Topic:

Introduction of the important functions in Fluid v0.6

  1. Pod scheduling optimization based on data awareness
  2. Enhancement of the dataset manipulation(Automatic resiliency for datasets, Dynamic update of the dataset mount point)
  3. Implementation and enhancement of the cache engine(Implementation of the new dataset cache engine, High availability of the dataset cache engine)
  4. Discussion

Speaker:

  • @顾荣

Attendees:

  • @顾荣
  • @车漾
  • @谢远东
  • @徐之浩
  • @仇伶玮
  • @吕冬冬
  • @cegao
  • @苏锐
  • @陈国旺

Minutes:

  1. Pod scheduling optimization based on data awareness
  2. Enhancement of the dataset manipulation(Automatic resiliency for datasets, Dynamic update of the dataset mount point)
  3. Implementation and enhancement of the cache engine(Implementation of the new dataset cache engine, High availability of the dataset cache engine)
  4. Discussion

Attachments:

Video Records:

2021/07/28

Topic:

Optimize pod scheduling through fluid

  1. The background of the topic
  2. Existing problems
  3. Architecture and function
  4. Show a demo

Speaker:

  • @顾荣
  • @仇伶玮

Attendees:

  • @顾荣
  • @车漾
  • @谢远东
  • @徐之浩
  • @仇伶玮
  • @吕冬冬
  • @马浩
  • @L-Shen
  • @陈国旺
  • @李思勉

Minutes:

  1. The background of the topic
  2. Existing problems
  3. Architecture and function
  4. Show a demo

Attachments:

Video Records:

2021/07/14

Topic:

Fluid-Elastic Dataset for Kubernetes

  1. Why Fluid
  2. What's Fluid
  3. Fluid Architecture
  4. Roadmap

Speaker:

  • @顾荣
  • @车漾

Attendees:

  • @顾荣
  • @车漾
  • @谢远东
  • @徐之浩
  • @仇伶玮
  • @周佩洁
  • @尹文兵
  • @陈国旺
  • @李思勉

Minutes:

  1. Why Fluid
  2. What's Fluid
  3. Fluid Architecture
  4. Roadmap

Attachments:

Video Records:

2021/06/30

Topic:

  1. Self-introduction
  2. Add Tencent GooseFS Runtime Proposal
  3. Question and answer
  4. Show a demo

Speaker:

  • @顾荣
  • @谢远东

Attendees:

  • @顾荣
  • @车漾
  • @谢远东
  • @徐之浩
  • @仇伶玮
  • @Changjian Gao
  • @马浩
  • @wei wei
  • @陈国旺
  • @李思勉

Minutes:

  • Self-introduction
  • Add Tencent GooseFS Runtime Proposal
  • Question and answer
  • Show a demo

Video Records:

2021/06/16

Topic:

  1. Self-introduction
  2. The introduction of the project background, goal, governance model, and the plan
  3. Question and answer

Speaker:

  • @顾荣

Attendees:

  • @顾荣
  • @车漾
  • @谢远东
  • @徐之浩
  • @仇伶玮
  • @周佩洁
  • @马浩
  • @Ni Wang
  • @刘留
  • @陈国旺
  • @李思勉

Minutes:

  • Self-introduction
  • The introduction of the project background, goal, governance model, and the plan
  • Question and answer

Video Records: