Fix for crash happening on blender exit after the bake

The issue is caused by 1a79abda, and annoyingly it's a regression
since 2.69, so if we do 'a', this commit should be ported there.