{"id":1777,"date":"2013-04-23T01:59:18","date_gmt":"2013-04-23T08:59:18","guid":{"rendered":"http:\/\/zachfine.com\/blog\/?p=1777"},"modified":"2026-11-17T14:14:56","modified_gmt":"2026-11-17T22:14:56","slug":"fitz-and-the-tantrums-video-out-of-my-league-crazy-lo-fi-3d-with-kinect-and-rgbdtoolkit","status":"publish","type":"post","link":"https:\/\/zachfine.com\/blog\/2013\/04\/23\/fitz-and-the-tantrums-video-out-of-my-league-crazy-lo-fi-3d-with-kinect-and-rgbdtoolkit\/","title":{"rendered":"Fitz and the Tantrums Video: &#8220;Out of my league&#8221;, crazy lo-fi 3D with Kinect and RGBDToolkit"},"content":{"rendered":"<br \/>\n\n<iframe loading=\"lazy\" title=\"Fitz and the Tantrums - Out of My League\" src=\"https:\/\/player.vimeo.com\/video\/64352316?dnt=1&amp;app_id=122963\" width=\"500\" height=\"281\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write; encrypted-media; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\"><\/iframe>\n\n <p><a href=\"http:\/\/vimeo.com\/64352316\">Fitz and the Tantrums &#8211; Out of My League<\/a> from <a href=\"http:\/\/vimeo.com\/jordanbahat\">Jordan Bahat<\/a> on <a href=\"http:\/\/vimeo.com\">Vimeo<\/a>.<\/p><p>\r\nMy friend <a href=\"http:\/\/toyhuman.com\/\">Jordan<\/a> directed this music video for the band Fitz and the Tantrums (released on 4\/22 <a href=\"http:\/\/www.vh1.com\/video\/fitz-and-the-tantrums\/901796\/out-of-my-league.jhtml#id=1589364\">on VH-1<\/a> and <a href=\"http:\/\/www.fitzandthetantrums.com\/blog\/fitz-and-tantrums-out-my-league-video-premiere-19661\">on the band&#8217;s web page<\/a> and <a href=\"https:\/\/vimeo.com\/64352316\">on vimeo in better quality<\/a>), and I got to help plan and execute a technically unorthodox portion of the shoot. It&#8217;s a little odd for me to be involved on the production end of a project and to not work all the way through post-production (on films, post often lasts for more than a year) \u2013but it was fun to shoot a bunch of stuff, hand it to the producer, and then see the final result weeks later. Now I know a little better how production folk must feel. Kudos to Jordan and producer <a href=\"http:\/\/www.imdb.com\/name\/nm2967341\/\">Taylor<\/a> for seeing the project through to the end.<\/p><p>\r\n<div style=\"width:300px;float:right\" class=\"photocaption\"><a href=\"http:\/\/zachfine.com\/blog\/wp-content\/uploads\/2013\/04\/IMG_2105-Version-2.jpg\" onclick=\"window.open('http:\/\/zachfine.com\/blog\/wp-content\/uploads\/2013\/04\/IMG_2105-Version-2.jpg','popup','width=870+20,height=1099+20,scrollbars=no,resizable=yes,toolbar=no,directories=no,location=no,menubar=no,status=yes,left=0,top=0');return false\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/zachfine.com\/blog\/wp-content\/uploads\/2013\/04\/IMG_2105-Version-2-tm.jpg\" height=\"378\" width=\"300\" border=\"1\" hspace=\"4\" vspace=\"4\" alt=\"A preview of the depth map as it was being recorded to a laptop during the shoot.\" title=\"A preview of the depth map as it was being recorded to a laptop during the shoot.\" longdesc=\"A preview of the depth map as it was being recorded to a laptop during the shoot. The different colors represent the depth at each point. Black spots represent holes in the data --areas in which no depth was recorded.\" \/><\/a><br clear=all\/>A preview of the depth map as it was being recorded to a laptop during the shoot. The different colors represent the depth at each point. Black spots represent holes in the data &#8211;areas in which no depth was recorded.<\/div>\r\nAt around 30 seconds in, you&#8217;ll start to see the lo-fi 3D imagery I helped capture and visualize \u2013point clouds and wire-mesh renditions of members of the band, rendered from various virtual camera positions.<\/p><p>\r\nThe data was shot head-on from a fixed camera position <sup data-fn=\"ea98e2c3-c02c-47ce-9263-4f6a8616bbb6\" class=\"fn\"><a href=\"#ea98e2c3-c02c-47ce-9263-4f6a8616bbb6\" id=\"ea98e2c3-c02c-47ce-9263-4f6a8616bbb6-link\">1<\/a><\/sup>, using a Canon 5DmkIII DSLR to capture video and a Microsoft Kinect sensor connected to a laptop to capture a video depth map. The DSLR and the Kinect were locked to one another with a <a href=\"http:\/\/www.thingiverse.com\/thing:27510\">3D-printed mount<\/a>. <a href=\"http:\/\/www.jaytrautman.com\/\">Jay Trautman<\/a> <sup data-fn=\"a74a346b-f9a0-43fe-b1ed-07eb14ce6df0\" class=\"fn\"><a href=\"#a74a346b-f9a0-43fe-b1ed-07eb14ce6df0\" id=\"a74a346b-f9a0-43fe-b1ed-07eb14ce6df0-link\">2<\/a><\/sup> (thanks!) operated the laptop while I manned the DSLR.<\/p><p>\r\nThe depth information for each pixel (or &#8216;D&#8217;) captured on the Kinect was recorded and later paired with the video info for that pixel (RGB) using a piece of free software <sup data-fn=\"d000beb0-a96f-4d8c-8a5e-835c5d5585ae\" class=\"fn\"><a href=\"#d000beb0-a96f-4d8c-8a5e-835c5d5585ae\" id=\"d000beb0-a96f-4d8c-8a5e-835c5d5585ae-link\">3<\/a><\/sup> called <a href=\"http:\/\/www.rgbdtoolkit.com\/index.html\">RGBDToolkit<\/a>. It&#8217;s fun to play with. If you&#8217;ve got a Kinect and a video camera, you might give it a try.\r\n<\/p><p>\r\nThere were some even-more-ambitious 3D data capture techniques at play during the shoot, involving an array of kinects and cameras (thanks <a href=\"https:\/\/www.google.com\/url?sa=t&amp;rct=j&amp;q=&amp;esrc=s&amp;source=web&amp;cd=1&amp;cad=rja&amp;ved=0CDQQFjAA&amp;url=http%3A%2F%2Fwww.onformative.com%2F&amp;ei=FUt2UcvNDYfjiAKFiIHABA&amp;usg=AFQjCNEyHSMZfeskxm6VnNxow1enxjmSiw&amp;sig2=zjbmbNyQLvw0a2IygkH07Q&amp;bvm=bv.45580626,d.cGE\">Cedric<\/a>!), which I&#8217;ll talk about another time. The non-3D shots were also captured on a Red Epic camera by D.P. <a href=\"http:\/\/wheelsdp.com\/\">Andrew Wheeler<\/a> and his team.<\/p><p>\r\n<a href=\"http:\/\/jfineoriginalportfolio.wordpress.com\/storyboards\/\">My cousin Jenny<\/a> did some great storyboards for the video, if they make it into her portfolio I&#8217;ll link to &#8217;em. A ton of other people worked on the video. I&#8217;ll link to the full credits soon if I can find them.<\/p>\n\n<ol class=\"wp-block-footnotes\"><li id=\"ea98e2c3-c02c-47ce-9263-4f6a8616bbb6\">i.e. the camera was locked into position using a tripod <a href=\"#ea98e2c3-c02c-47ce-9263-4f6a8616bbb6-link\" aria-label=\"Jump to footnote reference 1\">\u21a9\ufe0e<\/a><\/li><li id=\"a74a346b-f9a0-43fe-b1ed-07eb14ce6df0\">I worked with him previously on <em>The Man with the Iron Fists<\/em> <a href=\"#a74a346b-f9a0-43fe-b1ed-07eb14ce6df0-link\" aria-label=\"Jump to footnote reference 2\">\u21a9\ufe0e<\/a><\/li><li id=\"d000beb0-a96f-4d8c-8a5e-835c5d5585ae\">free as in beer and as in &#8220;MIT license&#8221; <a href=\"#d000beb0-a96f-4d8c-8a5e-835c5d5585ae-link\" aria-label=\"Jump to footnote reference 3\">\u21a9\ufe0e<\/a><\/li><\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Fitz and the Tantrums &#8211; Out of My League from Jordan Bahat on Vimeo. My friend Jordan directed this music video for the band Fitz and the Tantrums (released on 4\/22 on VH-1 and on the band&#8217;s web page and on vimeo in better quality), and I got to help plan and execute a technically [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_hide_featured_image":false,"_jetpack_featured_image_duplicate_dismissed":0,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"[{\"content\":\"i.e. the camera was locked into position using a tripod\",\"id\":\"ea98e2c3-c02c-47ce-9263-4f6a8616bbb6\"},{\"content\":\"I worked with him previously on <em>The Man with the Iron Fists<\/em>\",\"id\":\"a74a346b-f9a0-43fe-b1ed-07eb14ce6df0\"},{\"content\":\"free as in beer and as in \\\"MIT license\\\"\",\"id\":\"d000beb0-a96f-4d8c-8a5e-835c5d5585ae\"}]","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[28,13,40,3],"tags":[2622,2614,2611,2613,2615,230,1842,2618,2612,2354,2620,2075,2293,2607,2617,2619,2608,573,2616,2610,2609],"class_list":["post-1777","post","type-post","status-publish","format-standard","hentry","category-filmmaking","category-geeky","category-music","category-video","tag-bahat","tag-camera-position","tag-camera-positions","tag-data-areas","tag-different-colors","tag-dslr","tag-final-result","tag-fitz","tag-fixed-camera","tag-iron-fists","tag-kudos","tag-music-video","tag-pixel","tag-point-clouds","tag-renditions","tag-tantrums","tag-vh-1","tag-video-camera","tag-video-info","tag-virtual-camera","tag-wire-mesh"],"jetpack_publicize_connections":[],"jetpack_shortlink":"https:\/\/wp.me\/ptNpF-sF","jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/posts\/1777","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/comments?post=1777"}],"version-history":[{"count":5,"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/posts\/1777\/revisions"}],"predecessor-version":[{"id":11068,"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/posts\/1777\/revisions\/11068"}],"wp:attachment":[{"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/media?parent=1777"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/categories?post=1777"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/zachfine.com\/blog\/wp-json\/wp\/v2\/tags?post=1777"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}