@pakz: I don’t think, that lighting would need that information, but you are right, physics definitely does need it. Rendering models independent from the scene could not use mojo’s physics.
@Simon Armstrong: »Have you tried seeing how many ducks you can render?« No, but it would not work with the concepts that I had in mind earlier. I think the best way is to load segments of the game world and then free them when they are too far away. Well, sometimes I fail to see the simple solutions … maybe I was too obsessed by the idea of rendering everything on the fly.
Thank you both for your help!