You would in fact have to film them at every possible angle at once (well, from a reasonable number of them), which would require hundreds of cameras going simultaneously (a bit like how they did the "bullet time" effects in the matrix, but using a full hemisphere of cameras surrounding the scene, all of which would have to be painted out in post production). Then, you'd have the videos of all of the different angles playing back at the same time, and have the engine rapidly switch from one video to another to another every new frame of animation, as you moved around the character, so it would look like they were moving in real space at the same time as you were. That is insane. I'm sure someday we'll see it as a novelty, but not in a full game.
Also that doesn't account at all for how people get distorted and the perspective of their limbs and face change as you move a camera (or the human eye) closer and farther from them, so if you got close up to these people, perspective would go all wonky. Their noses would look flat, their hands would reach forward to touch you, but it would just look like they were waving at you from a long ways away through a pair of binoculars.
|