Yes, I understand. 

I figured something would get in the way. 

Oh well. It's still an awesome thing you have going here. 

Would it not be possible to load a certain detail level of the tiles when the zoom level gets between certain points? I.E. - When it's between, say, 90-100% zoom, load the max detail tiles, and then another range for the next detail level, etc. 

Seems a bit 'cheat-ey', but it should work.