Play Dress Up With Kinect

kinect_virtual_dressing_room

While we have seen Kinect-based virtual dressing rooms before, the team at Arbuzz is taking a slightly different approach (Translation) to the digital dress up game. Rather than using flat images of clothes superimposed on the subject’s body, their solution uses full 3D models of the clothing to achieve the desired effect. This method allows them to create a more true to life experience, where the clothing follows the subject around, flowing naturally with the user’s movements.

Like many other Kinect hacks, they use openNI and NITE to obtain skeletal data from the sensor. The application itself was written in C# with Microsoft’s XNA game development tools, and uses a special physics engine to render the simulated cloth in a realistic fashion

[Lukasz] says that the system is still in its infancy, and will require plenty of work before they are completely happy with the results. From where we’re sitting, the demo video embedded below is pretty neat, even if it is a bit rough around the edges. We were particularly pleased to see the Xbox’s native Kinect interface put to work in a DIY project, and we are quite interested to see how things look once they put the final touches on it.

[vimeo http://vimeo.com/25933286 w=470]

20 thoughts on “Play Dress Up With Kinect

  1. @Jay – You weren’t frightened by the virtual women’s clothing on the guy? The skirt was particularly odd, but the effect was kinda cool. Modify it to use armor from a game like Dragon Age or something, and it would be quite a bit more interesting to me.

  2. It’s nice but it needs a lot of work and I’m not sure the kinect can offer the resolution required for it, I could be wrong. Clothes fitting is (at least for me) a fine art – and I’m no fashion guru. But a fault can be as small as how this hangs aruond your particular leg shape, or how this colour works with your skin colour and without decent 3d mapping of body curves and colour matching it#s going to be nothing but a gimmick. A fun one.

  3. I really wonder when people will be able to get that horrible lag out of the Kenect. Is it that these guys all own horribly slow PC’s or does the Kenect it’s self lag that badly?

  4. @ James, I think there are some issues for a start because the guy is fully clothed already, the virtual clothing looks like its one size fits all as well, its a proof of concept, so when it’s cleaned up I would expect there to be a way to choose a size that fits your shape better and make the whole experience a lot more rewarding. I fully expect the updated version to use 2 kinects so he can give us a twirl :D

  5. i like how he selected women’s clothing. also the dancing was nice for change instead of being all stiff. the non emotion on his face and contraction was kind of funny when he was dancing.

    @james he could of done it in a speedo to get a better fit. but i don’t think i would of liked the video as mush lol.

  6. There were systems like this before for virtual cloth fitting, but they were computationally expensive and difficult to set up (multiple cameras and so on).

    This should be easy to set up in a shop window so passing by women stop and try clothes = instant shop magnet.

  7. Takes a braver man than most to dance around like that in a virtual skirt on the Internet. :)

    It works pretty well. Might be interesting to compare video frames to distinguish background from person (and existing clothes), and stretch the virtual clothing a bit to cover better.

  8. The video was very strange. The dude was very strange.

    But yeah that one dude could get full speed in his slow microcontroller to play pong and an old camera.
    Then you have a cutting edge microsoft product running windows.

    There shouldn’t be any lag.

  9. He has to model the shirt first so the kinect can take his 3d picture, right? or could anyone / any mannequin model it and still produce a decent 3d model on him?

Leave a Reply

Please be kind and respectful to help make the comments section excellent. (Comment Policy)

This site uses Akismet to reduce spam. Learn how your comment data is processed.