Motr Deep Dive Sessions - Seagate/cortx-motr GitHub Wiki

This page is created for the CORTX Open Source community. The CORTX-Community can join the upcoming training using the provided invite or view the recordings of previously recorded sessions.

Date Training Agenda Presenter Invite Presentation Link Recording Link Comments
04-Feb-2021 Motr Libraries Nikita   Presentation MP4 Motr libraris source code / headers
09-Feb-2021

DTM Design:

  • Metadata DTM
  • Data DTM
  • Performance implication
  • Using special hardware to speed-up performance
 Anatoliy   Presentation MP4  
16-Feb-2021 State machines, ASTs, and localities Nikita   Presentation MP4  
18-Feb-2021

RPC and FOPs:

  • Coalescing of RPC request
  • Possible improvements
  • Timeout and error handling
  • Deadlock detection
  • xcode
 Madhav   Presentation MP4  
23-Feb-2021

Request handler, and FOM:

  • Queuing of IOs in motr?
  • Adding support to stop processing new IOs and keep adding them to queue. (queue non-volatile?)
  • Types of FOM
    • Read FOM
    • Write FOM
    • CAS FOM etc
  • FOM Scheduling and AST
  • Advantages and disadvantages of AST
  • Possible design alternatives to AST
 Madhav and Nikita     MP4

Nikita to provide sessions on:

  • Advantages and disadvantages of AST
  • Possible design alternatives to AST
25-Feb-2021

Transactions:

  • Interface, high-level model of data flows inside BE
  • Why do we need BE
 Anatoliy   NA MP4  
11-Mar-2021

Transactions:

  • Write Log Ahead, FOL conceptual view
  • Logging Structure
  • Group and its impact on performance
  • Stob IO performance for transactions and how it can be speed up
  • Use of SSDs for metadata
  • Credit Calculations
 Anatoliy   NA MP4  
25-Mar-2021

State machines, asts, fom, practical example of writing and debugging

 Ivan A   PDF MP4  
15-Apr-2021

ADDB Tools

  • Practical example of instrumentation
  • Practical usage of ADDB DB
  • Practical data extraction
 Maxim Malezhin     MP4  
6-May-2021

Balloc:

  • Current Algo
  • Possible new algo and limitations
  • Best choice for our workload
 Huanghua and  Shashank   MP4  
20-May-2021 Parity declustering Nikita     MP4  
TBD

Layout and Pools Versions:

  • Formulaic Pool Versions Details
  • Switching Policy
 Nikita        
TBD

Write object flow end-to-end:

  • Code flow and important data structure
 Nikita        
TBD

Read object flow end-to-end:

  • Code flow and important data structure
 Nikita        
TBD

Metadata operation flow for following use case:

  • Reads (lookup)
  • Write (lookup and update)
  • DIX PUT
  • DIX GET
  • DIX DELETE
 Nikita        
TBD

Resource Manager:

  • RM Selection if current one goes down
  • Use case for read and write
  • Resource Locking and failure handling
          
TBD

Confd:

  • Topology and its mapping with motr data structure
  • How the data structure gets update with HA events
  • Types of external Hare Event Motr process
          
TBD Motr Client (Clovis) and its functionality Madhav        
TBD

B-Tree in Motr:

  • Current structure
  • Typical B-Tree node addition, removal and its add operation to transaction
  • Basic B-Tree operation standard can we separate them from motr action and database
  • Can we get rid of volatile files from node? will help in Swap Space Task
  • Credit calculations
  • New B-Tree Design
 Nikita        
TBD

SNS Repairs:

  • Current Design
  • Data Rebalance
  • Metadata Rebalance
  • Sliding Window Protocol advantage and disadvantage
 Nikita        
TBD Debugging tools and techniques Anatoliy        

 

⚠️ **GitHub.com Fallback** ⚠️