Thursday, December 3, 2009

Silverlight 4 Augmented Reality Proof Of Concept

Please goto: World# - Real Time 3D Augmented Reality with Silverlight. Such demos are now easily possible with the open source SLARToolkit.

In this short blog post I want to present a demo I've actually made last week. Unfortunately I had no time to work on it since then. This demo is a proof of concept for doing Augmented Reality with Silverlight 4 and the built-in webcam API.
I use the open source Augmented Reality library NyARToolkitCS and implemented the necessary interfaces to make it work with Silverlight. The NyARToolkitCS library is a completely managed version of the well known ARToolkit.

Video
I've recorded a short video with my iPhone 3GS. The video was recorded at night and it's no secret that the iPhone camera is not the best, but I think it's good enough to see how the marker is tracked and the Silverlight logo moves with it.


Background music is "You have something in your scowl" by Henrik José / Bliss.


To be continued
The first results are quite good and the demo runs smoothly at 60-70 fps on a dual core machine utilizing both cores. I will continue my work on this project and provide more details, samples and of course source code.
Stay tuned...

36 comments:

  1. Nice work man! I was wondering who was going to get to this first. Looking forward to the next post :)

    ReplyDelete
  2. Thanks Adam! I really appreciate your comment.

    ReplyDelete
  3. Rene, awesome post mate... Keep up the good work!!

    ReplyDelete
  4. Excellent! Can you show us your source code?

    ReplyDelete
  5. Thanks!

    @Dimitris As I wrote I will release the source code in an upcoming blog post, but I have to clean it up first.

    ReplyDelete
  6. Can you tell us the artist and name of the song as well? :)

    ReplyDelete
  7. I had written the song and the artist name in the YouTube Infos about the Clip. I just added it to this blog post for you (below the embedded video). Henrik made / makes a lot of fantastic music. Check out the link for more great tracks.

    ReplyDelete
  8. Really cool.

    Can't wait to see where this goes next.
    For some odd reason, SL4 poped up an error message on my MAC when trying to capture the Web Cam. Something I must investigate further - the error message was scary enough, COM related. Last time I checked, COM is not on OSX. :)

    ReplyDelete
  9. Thanks Einar. I really appreciate it.
    LOL - a COM error on a MAC. Now that's a weird bug. :) Unfortunately I don't own a MAC, but I asked via Twitter if someone with a MAC and SL4b could test it and I got positive feedback. I've also read that some people encounter strange issues that are caused by the webcam.
    Have you tested my other webcam demos I've posted before "EdgeCam..."?

    ReplyDelete
  10. I guess this is a problem with my configuration.

    Tried a different demo that lead me to a path of fixing my issues. That one said I had no default capture device, fired up Skype and it said the same. So - I guess I need to turn of USB support in Parallels, even though I've not connected my iSight to it Parallels as a peripheral it can use.

    I'll try the demo after I've done it all.

    ReplyDelete
  11. Get a bad HRESULT from a call to the webcam. Safari reacts better than Firefox, which brings up a crash dialog.

    ReplyDelete
  12. PS, it would be good to say how large to print the tracking marker. It printed out 8.5x11 and is soaking wet with ink :) I think I could have printed much smaller...!

    ReplyDelete
  13. Thanks for testing it out, Nick and sorry for the waste of ink. I updated the text above.

    There might be an issue with this version of
    Silverlight and the webcam support on MACs. Although it's still the first beta and I hope it will get fixed in subsequent releases.
    Could you please post the complete error you have encountered so I can send it to the Silverlight team? Which version of Safari, Firefox and Snow Leopard have you used for test and on what MAC?
    Sorry for the bad experience, but I don't own a MAC myself and therefore I'm not able to test it on that platform. Again, thanks for trying it!

    ReplyDelete
  14. An excellent demonstration of next-generation web technology, powered by Silverlight! More demos like this please!

    ReplyDelete
  15. Absolutely Good Job.. Keep up the Good Work !!!

    ReplyDelete
  16. Very cool post. Nice job. I look forward to more to come. -joel

    ReplyDelete
  17. Genius work here Rene, very impressed indeed.

    I shall be keeping a close eye on this work!

    ReplyDelete
  18. Thank you all.

    I wrote a follow up:
    "World# - Real Time 3D Augmented Reality with Silverlight"
    http://kodierer.blogspot.com/2009/12/world-real-time-3d-augmented-reality.html

    ReplyDelete
  19. Rene Schulte, nice work. You rock! Gottah love AR.

    I had the same issue running all of your webcam demo's in osx, but it seems to me that SL4 beta default video source is actually by default incorrect. The problem can be resolved by going to the Silverlight preferences, and changing the default video source under the Webcam/mic tab from DV to built in i-sight. Voila, we are good to go:)

    ReplyDelete
  20. Thanks for the solution for the MAC default webcam issue.

    ReplyDelete
  21. Could you send the source??
    thanks.

    Humberto Lins

    ReplyDelete
  22. Hi Humberto. I will soon release the source and even more. I'm working on SLARToolkit, the Silverlight Augmented Reality Toolkit. :) So please stay tuned.

    ReplyDelete
  23. About this Silverlight 4 is perfect because I was watching the video and the last result is amazing I'm thinking on make this at home.

    ReplyDelete
  24. Really good work! I see progress here!

    ReplyDelete
  25. Artículo muy interesante e informativa. Lea con mucha facilidad. Tales artículos de calidad realmente muy poco ahora.

    ReplyDelete
  26. I really treasure this wonderful write up. I really appreciate the information you have provided in this article. Thanks a lot!

    ReplyDelete
  27. hello all, interesting article here...hhahah..

    ReplyDelete
  28. hi, why you not update your site anymore?

    ReplyDelete
  29. great topic, i will put a link back from my blog to this article, i like this article :)

    ReplyDelete
  30. hello there, what you wrote there so interesting, i am so enjoy my stay here, great

    ReplyDelete
  31. hello sir, can you teach me how to write a nice article like yours? :D

    ReplyDelete
  32. interesting article and topic, awesome!

    ReplyDelete