General: Other Processes: Overflow Process - FlipsideCrypto/fsc-evm GitHub Wiki

The Overflow Process is a set of models designed to work around Snowflake size limitations (16mb/cell). We request data by block, and flatten it to the transactional level before landing it in Snowflake. Occasionally, but very rarely, a transaction will exceed this 16mb limit with hundreds of thousands of traces or event logs. In these cases, we need the overflow process to load this data to Snowflake.