Revert "Fix #131134: EEVEE: Playback performance degrades over time"

This reverts commit f6c4841e.

This fix caused a regression (#131420) whose fix was not added to the
backport list.
Reverting this (with permission from @lichtwerk) since it's safer than
including the second fix at the last minute.

Pull Request: https://projects.blender.org/blender/blender/pulls/131988