Read about different replacement strategies. What other strategies exist?
A good overview can be found in the following article:
https://en.wikipedia.org/wiki/Cache_replacement_policies
There is little difference between these for caches or for virtual memory, because the latter can be viewed as a particular type of cache.