Design:

3 separate parts

Abstractions.

Mechanisms.

Separate Mechanisms to support many policies.

Policies

Last Recently Used, Least Frequently Used, random...

Optimize for common case

Where will be used? What will the user want? What are the work requirements?