{"id":154,"date":"2016-12-21T10:46:31","date_gmt":"2016-12-21T15:46:31","guid":{"rendered":"http:\/\/www.talariavr.com\/blog\/?p=154"},"modified":"2016-12-21T10:46:31","modified_gmt":"2016-12-21T15:46:31","slug":"steamvr-tracking-license-recap","status":"publish","type":"post","link":"http:\/\/www.talariavr.com\/blog\/steamvr-tracking-license-recap\/","title":{"rendered":"SteamVR Tracking License Recap and Answering Questions"},"content":{"rendered":"

Review<\/strong><\/span><\/p>\n

First of all, really sorry about the delay here between hardware posts. \u00a0This one was stuck in approval for a while and made its way around, ultimately receiving\u00a0the go-ahead from Valve. \u00a0So while it may be a long time coming, hopefully this in-depth review of content will really help those of you interested in\u00a0the design of SteamVR tracked objects better understand the nuances of sensor placement. \u00a0Expect to see a good deal more hardware posts in the coming weeks (I’ve got quite a backlog to push out!)<\/span><\/span><\/p>\n

So again,\u00a0the training course was great. \u00a0As a launchpad, if you want to read over my full experience of it, here are links to Day 1<\/span><\/span><\/a>, Day 2<\/span><\/span><\/a>, and Day 3<\/span><\/span><\/a> of the training, as well as the category page for the tracking license<\/span><\/span><\/a>.<\/span><\/span><\/p>\n

Reviewing over all the content that was learned and experiences had, I’d have to say that the most important takeaway from the course was understanding and optimizing sensor placement. \u00a0The math for it is just beautiful. \u00a0Below I’ll go ahead and break down what each additional sensor adds to tracking stability:<\/span><\/span><\/p>\n

0 Sensors (Basestation Protocol)<\/strong>
\n<\/span><\/span>Well, all you have right now is a space that has lasers sweeping through it. \u00a0The protocol a single basestation emits goes as follows: an array of infra-red LEDs pulses for a specific length of time. \u00a0Then, a vertical fan of infrared light is\u00a0scanned horizontally through the space, at a field-of-view of 120 degrees, rate of 60 Hz. \u00a0After another pulse, a horizontal fan of the same characteristics scanning vertically then follows. \u00a0This process is then repeated so long as the basestations have power!<\/span><\/span><\/p>\n

1 Sensor (X- & Y-Position)<\/strong>
\nYour first sensor will give you an x and y radial coordinate. \u00a0So if you think about how a single sensor sees a basestation, it sees the sync pulse and starts its timer. \u00a0Then, once contacted by the first sweep, the time signature of this event is saved, and our sensor knows it exists somewhere within the area of that vertical fan at that specific time. \u00a0After the second sweep arrives, our sensor can further narrow down its position to be where the time signature positioning of the horizontal and vertical sweeps overlap. \u00a0Visualizing this, we now have a single line of potential locations radiating from the basestation. \u00a0Our radial x and y coordinates have been established, but our sensor can still reside anywhere on the radial z-axis.<\/span><\/span><\/p>\n

2 Sensors (Z-Rotation)<\/strong>
\nNext we add a second sensor. \u00a0The benefit of this one is that by knowing the x- and y-position of each sensor (which are of a fixed placement apart), we get an understanding for how our object is oriented along the z-axis. \u00a0And let me say here that these (and all future) sensors need to be rigidly attached! \u00a0Without that, our system will simply know the radial z position for each sensor but no reference for where each sensor is to one another, and therefore not be able to lock down any more pose information. \u00a0But a problem still presents itself with two sensors on the object: each sensor could still exist anywhere on that radial z-axis. \u00a0Because of that, our object could be anywhere from extremely distant and facing normal to the basestation, or extremely near and severely angled to the basestation. \u00a0The sensors would still be hit by the laser sweeps at the same times. \u00a0This is referred to as pose translation error.<\/span><\/span><\/p>\n

3 Sensors (Z-Position)<\/strong>
\nOn to a third sensor, let’s first imagine three sensors together in a line. \u00a0We’ll still see the same\u00a0pose translation error as described above; each sensor will still be proportionally related as the angle increases and position grows nearer. \u00a0To mediate this, let’s attach that third sensor to be non-collinear to the other two. \u00a0Now, when our object angles towards the basestation and gets closer, we would expect to see that third non-collinear point to have a more pronounced offset from the other two. \u00a0Using this understanding, 3 sensors can finally lock down our z-position. \u00a0Hooray! \u00a0But we’re not out of the woods yet. \u00a0No matter how precise they’re manufactured, basestations will inherently have a small (VERY small) amount of wobble to them, as well as there being IR-distortions inside the tracking volume (such as heat waves). \u00a0Because of this minor error, the current system is not precise enough to discern between 3 sensors that are facing head-on and 3 sensors that are skewed by a few degrees along the x- and y-axes. \u00a0This is referred to as pose rotation error.
\n<\/span><\/span><\/p>\n

4 Sensors (X- & Y-Rotation)<\/strong>
\nSo now to the last required sensor; number four. \u00a0If our fourth sensor resided in the same plane as the other three, then we would have the same issue with pose rotation error. \u00a0To get around that, we pull it out of the plane. \u00a0With four non-coplanar sensors, this helps because as an object rotates now, we get the parallax of angular motion, and that parallax really helps eliminate a wide range of possible poses that were present from the inherent basestation error. \u00a0We refer to that as establishing the baseline.
\n<\/span><\/span><\/p>\n

>4 Sensors (Occlusion Protection & Redundancy)<\/strong>
\n<\/span><\/span>Great! \u00a0We have a reliable motion-captured object that SteamVR will be happy to use! \u00a0But of course the issue still exists of turning the device away \/ occluding the sensors from a basestation. \u00a0For this, we need to be sure that all angles and occlusions are accounted for. \u00a0That’s where Valve’s HMD Designer software comes into play (visualizations can be seen in my Day 2<\/span><\/span><\/a> post, as well as in future content). \u00a0Additionally, adding more than 4 sensors in the same visible\u00a0area creates redundancies, and (while it will increase the cost of the device) redundancies can only help maintain even more stable tracking. \u00a0The maximum sensors that can be used in the present firmware are 32 sensors on one device, and this device is an HMD with very few inputs. \u00a0For a controller with 1 analog and 5 digital inputs (and the x\/y serial input of the trackpad), I believe the sensor cap is 28.<\/span><\/span><\/p>\n

So that about wraps up an in-depth review of the SteamVR Tracking system! \u00a0Again, my apologies that it took so long to post publicly; really hoping to be in a steady rhythm for this blog now. \u00a0Feel free to let me know if any of these points require clarification.
\n<\/span>
\nAnswering\u00a0Community Questions<\/strong><\/span><\/span><\/p>\n

Below are (paraphrased) questions that were raised by members of the community on Reddit<\/a><\/span><\/span>, by email<\/a><\/span><\/span>, or here on the blog<\/a><\/span>.<\/span> \u00a0If you asked a question through any of these media and it is not<\/em> featured here, it may be that it was very specific, or covered in great depth in a previous post. \u00a0If you don’t personally hear from me sometime in the next week, feel free to ping me<\/a><\/span> with that question again.<\/span><\/p>\n

Any word on larger tracked volumes \/ more than 2 lighthouses?<\/span><\/strong>
\n<\/span><\/strong>Asked in combination by Lanfeix<\/a><\/span><\/span>\u00a0on Reddit<\/span><\/span><\/a> and Bernd K. over email
\n<\/span><\/em>Valve is always\u00a0prototyping and testing many ideas, multiple lighthouses certainly being one of them. \u00a0As far as licensees are aware, however, no one design\u00a0has been locked down yet. \u00a0It was mentioned at Steam Dev Days that Valve hopes for lighthouse to be as ubiquitous as WiFi<\/span><\/a> in the future, so take that for what it’s worth!<\/span><\/p>\n

What are other developers working on? \u00a0Wireless HMDs, body tracking, modified controllers, etc…
\n<\/span><\/strong>Asked in combination by <\/span>Ducksdoctor<\/a><\/span><\/span>\u00a0on <\/span>Reddit<\/a><\/span><\/span>,\u00a0Guichla<\/a><\/span><\/span>\u00a0on Reddit<\/span><\/span><\/a><\/span>, and\u00a0darrellspivey<\/a><\/span>\u00a0on Reddit
\n<\/span><\/span><\/a><\/span><\/em>I am not at liberty to disclose any developmental plans for my colleagues from the training. \u00a0Regarding the wireless HMD modifications, however,\u00a0TPCAST<\/span><\/span><\/a> was announced as a Vive accessory while we were in training. \u00a0And as for body tracking, I can assure you that is a very frequently requested device \/ suite (and I’m personally working on evolving the Talaria locomotion wearable<\/span><\/span><\/a> to include lighthouse tracking; will open up foot-tracking to the masses, plus many other awesome features! \u00a0More info on that to come over the next month or so)<\/span><\/p>\n

What resources are available to the public to prototype for lighthouse? \u00a0Will audio\/video recordings and documentation ever be made publicly available?<\/span><\/strong>
\n<\/span><\/strong>Asked in combination by Mentalyspoonfed<\/a><\/span><\/span>\u00a0on Reddit<\/span><\/span><\/a>,\u00a0thebigman433<\/a><\/span>\u00a0on Reddit<\/span><\/a><\/span>, VRGameZone<\/a><\/span><\/span>\u00a0on Reddit<\/span><\/span><\/a>, and over\u00a0email
\n<\/span><\/em>Anyone is welcome to play around with the technology – Triad Semiconductor sells their TS3633 castellated modules<\/span><\/span><\/a> for about $7 a pop, and they have everything on board to sense the IR signal from a basestation and convert it to a digital output. \u00a0That being said, without access to the hardware (which comes with the license), you will have no way of communicating that sensor data to SteamVR – you would be required to run motion capture in your own application (but that’s not to say<\/span><\/span><\/a> it can’t be done<\/span><\/span><\/a>!). \u00a0At this time, taking Synapse’s SteamVR Tracking training<\/span><\/span><\/a> is required to ensure everyone is properly prepared to develop for lighthouse in these early days of the technology. \u00a0In the future, Valve has intentions to make the training and documentation fully available to the public, but that will likely come after this first batch of trainees have enough time to give feedback and work out the kinks. \u00a0And I personally was able to take an audio recording of the course, however that is restricted to internal use only.<\/span><\/p>\n

I thought the magic number of required sensors used to be five – why do you keep saying four? \u00a0Is it possible to capture position using just one sensor?
\n<\/span><\/strong>Asked in combination by Mark Hogan on the blog<\/a><\/span>\u00a0and Bernd K. over email
\n<\/span><\/em>As stated above, one sensor will let you lock down an x and y radial coordinate, but that sensor could exist anywhere in the radial z direction. \u00a0A second sensor locks down your rotation about the z-axis, but again position in the z direction will still be ambiguous (could be anywhere between far away and facing perpendicular to the basestation, or up very close at an extreme angle. \u00a0Both sensors will still be hit at the same times). \u00a0Adding in a third (non-collinear) sensor will allow you to establish the z-position of your device. \u00a0Then the reason for a fourth (non-coplanar) sensor is to aid in solidifying x- and y-axis rotations, as without the parallax of that fourth sensor it is very difficult to determine minor changes in x- and y- rotation. \u00a0As for why Valve used to say that you needed five to lock down a position, we don’t really know. \u00a0Stable tracking is successfully achieved with four – perhaps it was a safety measure for redundancy.<\/span><\/p>\n

How do tracked objects know which lighthouse hit it?
\n<\/span><\/strong>Asked by Mark Hogan on the blog
\n<\/span><\/span><\/a><\/span><\/em>The sync pulse from each base station lasts for a different amount of time depending on which channel that base is set to. \u00a0The IR sensors on each device can see this difference and it acts as a means of identification for each lighthouse.<\/span><\/p>\n

What’s the difference between a ‘chiclet’ and the TS3633-CM1<\/span><\/span><\/a>?
\n<\/span><\/strong>Asked by Bernd K. over email
\n<\/span><\/em>Both modules are functionally the same. \u00a0The chiclet provided to developers by Synapse is a more compact, dual-sided design that has a flex cable connector on it. \u00a0The CM1 is single-sided and pins out to castellations.<\/span><\/p>\n

What’s going to be covered at the SXSW SteamVR Tracking session<\/span><\/span><\/a>?
\n<\/span><\/strong>Asked by VRGameZone<\/a><\/span><\/span>\u00a0on Reddit
\n<\/span><\/span><\/a><\/span><\/em>This session will be an overview of what will be covered by the training. \u00a0Pretty much all the content we learned in Day 1<\/span><\/span><\/a> (not the full training). \u00a0To my understanding, there is no need to sign up; simply attend!<\/span><\/p>\n

So that’s everything you folks have asked me so far! \u00a0I hope the community finds the information here useful. \u00a0If you have any more questions, feel free to throw them to the comments<\/a>, or email me at\u00a0blog@talariavr.com<\/a><\/span><\/span>. \u00a0I’ve been quite busy this past month, so get excited for what’s coming next!<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Review First of all, really sorry about the delay here between hardware posts. \u00a0This one was stuck in approval for a while and made its way around, ultimately receiving\u00a0the go-ahead from Valve. \u00a0So while it may be a long time coming, hopefully this in-depth review of content will really help those of you interested in\u00a0the design of SteamVR tracked objects better understand the nuances of sensor placement. \u00a0Expect to see a good deal more hardware posts in the coming weeks…<\/p>\n

Read More Read More<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,7],"tags":[],"class_list":["post-154","post","type-post","status-publish","format-standard","hentry","category-steamvr-tracking","category-steamvr-tracking-license-steamvr-tracking"],"_links":{"self":[{"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/posts\/154","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/comments?post=154"}],"version-history":[{"count":13,"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/posts\/154\/revisions"}],"predecessor-version":[{"id":325,"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/posts\/154\/revisions\/325"}],"wp:attachment":[{"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/media?parent=154"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/categories?post=154"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.talariavr.com\/blog\/wp-json\/wp\/v2\/tags?post=154"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}