Recently at TED Blaise Aguera y Arcas stunned the crowd with a demo of a video playing in Bing Maps version of Street View. You can see the demo in action in the video below.
This got me thinking that this should be possible in Google Maps Street View. I knocked up this rather lame example showing a YouTube video embedded in Street View in under an hour today. This is just a demo to show what could be possible although it isn't the greatest example.
The demo would also work better if the video used was shot from exactly the same spot from where the Street View was taken. However despite it being a rather poor example I think it shows what could be possible.
Feel free to use the code if you think you can develop this further.