Following a comment by @hanslovksy:
  What might also be nice is to add the resolution and offset (or the
  affine) to each of s0, s1 etc, so you can load each mipmap level
  individually with the correct transform.