Talks
Siying Dong edited this page Apr 20, 2023
·
39 revisions
- 01:35 Kickoff/Introduction
- 05:20 XDP-Rocks: a Hardware-Accelerated RocksDB by Pliops
- 25:50 Speedb: Memory Management as a Stepping Stone to Auto-Tuning
- 1:01:00 Evolution of RocksDB at Nutanix
- 1:12:05 RocksDB Vision
- 1:33:55 DBtune : Database Tuning Software as a Service
- 1:45:26 Hyper-Clock Cache
- 1:55:10 Time Aware Tiered Storage
- 2:03:37 Parallel Iterator IO
- 2:14:15 Range Deletion Performance Improvement
- How Rockset built a Clustered Search Index using RocksDB (Rockset)
- Rolling with RocksDB (Miovision)
- Ribbon Filter Update (Facebook)
- RocksDB on Disaggregated Storage (Facebook)
- Stateful Stream Processing with Samza and RocksDB by Abhishek Shivanna and Ray Matharu, both from LinkedIn
- Characterizing, Modeling, and Benchmarking RocksDB Key-Value Workloads at Facebook by Zhichao Cao and Siying Dong, both from Facebook
- Kickoff: A quick overview of RocksDB new features (by Sagar Vemuri)
- Cassandra on RocksDB (by Pengchao Wang)
- MySQL and RocksDB (by Herman Lee)
- MyRocks In Production (by Domas Mituzas)
- State Management in Kafka Streams using RocksDB (by Guozhang Wang)
- Are you a Tortoise or a Hare (by Matthew Von-Maszewski)
- Workload Diversity with RocksDB (Siying Dong)
2016.12 8th RocksDB Meetup playlist
-
Lightning Talks (Facebook Engineers)
- Yueh-Hsuan Chiang -- Lua Compaction Filters
- Karthikeyan Radhakrishnan -- Read Cache
- Andrew Kryczka -- Improved Statistics/Delete Range
- Yi Wu -- Iterator Assited Inserts
- Anirban Rahut -- Large Value support
- Aaron Gao -- New iterator features
- Islam AbdelRahman -- Bulk loading
- Laurent Demailly -- RocksDB cloning at the speed of light with WDT
- Arun Sharma -- Iterlib: A zero copy iterator library
- RocksDB Future (Siying Dong @ Faceboook)
- The updated state of MyRocks, MongoRocks and RocksDB (Mark Callaghan @ Facebook)
- Talk from Percona (George Lorch @ Percona)
- Rocksplicator (Bo Liu @ Pinterest)
- RocksOS: Plug-in RocksDB Into ObjectStore (Praveen Rao @ Microsoft)
2016.06 6th RocksDB Meetup video
- Improving RocksDB’s Write Scalability (Nathan Bronson @ Facebook)
- Counting with Domain Specific Databases (Yunjing Xu @ Smyte)
- MyRocks, MongoRocks and RocksDB (Mark Callaghan @ Facebook)
- RocksDB: Key-Value Store Optimized for Flash-Based SSD (Siying Dong @ Facebook)
- Running MongoRocks in production (Igor Canadi @ Facebook)
2016.02 The Hive Think Tank "Rocking the Database World with RocksDB" [Video] (https://www.youtube.com/watch?v=g2PglBY_18w)
- Open Discussion on RocksDB Roadmap and Vision (Dhruba Borthakur @ Facebook)
- Ceph + RocksDB (Sage Weil)
- MongoDB + RocksDB (Igor Canadi @ Facebook)
- Use of RocksDB at Rakuten (Qian Zhu @ Rakuten)
- MySQL + RocksDB (Siying Dong @ Facebook)
2015.12 5th RocksDB Meetup [Video Playlist] (https://www.youtube.com/playlist?list=PLb0IAmt7-GS292rNhzcGTi5cOdcTuK70v)
- RocksDB Transactions (Anthony Giardullo @ Facebook)
- RealPin: A Highly Customizable Object Retrieval System (Bo Liu @ Pinterest)
- RocksDB on Open-Channel SSDs (Javier González @ CNEX Labs)
- RocksDB for Personalized Search At Airbnb (Tao Xu @ Airbnb)
- CockroachDB’s MVCC model (Spencer Kimball @ CockroachDB)
- Fine-tuning RocksDB (Praveen Krishnamoorthy @ Samsung Inc)
- The Journey From Faster To Better (Mark Callaghan & Igor Canadi @ Facebook)
- RocksDB: Challenges of LSM-Trees in Practice (Siying Dong @ Facebook)
- RocksDB storage engine for MySQL and MongoDB (Igor Canadi @ Facebook)
- Transactions on RocksDB (Anthony Giardullo @ Facebok)
- Lightning Talk "MySQL + RocksDB for better storage efficiency than InnoDB" (Siying Dong @ Facebook)
- Talks from Facebook RocksDB Team (Igor Canadi, Yueh-Hsuan Chiang and Siying Dong @ Facebook)
- Building queues that are Rocks solid (Reed Allman @ Iron.io)
- RocksDB usage at LinkedIn (Ankit Gupta and Naveen Somasundaram @ LinkedIn)
- RocksDB (Siying Dong @ Facebook)
- Supporting a 1PB In-Memory Workload (Haobo Xu @ Facebook)
- Column Families in RocksDB (Igor Canadi @ Facebook)
- "Lockless" Get() in RocksDB (Lei Jin @ Facebook)
- Prefix Hashing in RocksDB (Siying Dong @ Facebook)
- The History of RocksDB (Dhruba Borthakur @ Facebook)
Contents
- RocksDB Wiki
- Overview
- RocksDB FAQ
- Terminology
- Requirements
- Contributors' Guide
- Release Methodology
- RocksDB Users and Use Cases
- RocksDB Public Communication and Information Channels
-
Basic Operations
- Iterator
- Prefix seek
- SeekForPrev
- Tailing Iterator
- Compaction Filter
- Read-Modify-Write (Merge) Operator
- Column Families
- Creating and Ingesting SST files
- Single Delete
- Low Priority Write
- Time to Live (TTL) Support
- Transactions
- Snapshot
- DeleteRange
- Atomic flush
- Read-only and Secondary instances
- Approximate Size
- User-defined Timestamp
- Wide Columns
- BlobDB
- Online Verification
- Options
- MemTable
- Journal
- Cache
- Write Buffer Manager
- Compaction
- SST File Formats
- IO
- Compression
- Full File Checksum and Checksum Handoff
- Background Error Handling
- Huge Page TLB Support
- Tiered Storage (Experimental)
- Logging and Monitoring
- Known Issues
- Troubleshooting Guide
- Tests
- Tools / Utilities
-
Implementation Details
- Delete Stale Files
- Partitioned Index/Filters
- WritePrepared-Transactions
- WriteUnprepared-Transactions
- How we keep track of live SST files
- How we index SST
- Merge Operator Implementation
- RocksDB Repairer
- Write Batch With Index
- Two Phase Commit
- Iterator's Implementation
- Simulation Cache
- [To Be Deprecated] Persistent Read Cache
- DeleteRange Implementation
- unordered_write
- Extending RocksDB
- RocksJava
- Lua
- Performance
- Projects Being Developed
- Misc