Web semantics for sensory augmentation

Shinavier, Joshua
Thumbnail Image
Other Contributors
Hendler, James A.
McGuinness, Deborah L.
Hendler, James A.
McGuinness, Deborah L.
Braasch, Jonas
Spector, Lee, 1963-
Issue Date
Computer science
Terms of Use
This electronic version is a licensed copy owned by Rensselaer Polytechnic Institute, Troy, NY. Copyright of original work retained by author.
Full Citation
Such a system would need to respect the conditions under which the integration of cues will occur, which is a real-time problem as well as a problem of machine perception and semantic reasoning or querying. The applicable thresholds of perceptual synchrony are comparable to, and in many cases exceeded by, the delay of the simplest real-world sensor networks we might like to build, and semantic processing time is also a factor. The results of this dissertation are that the technical problem can in fact be solved, although any just-in-time operations are tightly constrained by the sensory modalities of the mapping, and by geography and network topology. A concrete architecture is provided as a proof of concept, along with a number of applications using cooperative event detection and wearable computers, semantic queries, and dynamic views of Web data for context awareness. A novel semantic query processor is introduced in order to answer complex queries continuously and within the real-time bounds over an unbounded stream of events. An evaluation of the system indicates that applications would scale up to handle infrequent events for very many users, or continuous events for a single user at a frequency high enough to enable recalibration of perceptual synchrony.
December 2015
School of Science
Dept. of Computer Science
Rensselaer Polytechnic Institute, Troy, NY
Rensselaer Theses and Dissertations Online Collection
Restricted to current Rensselaer faculty, staff and students. Access inquiries may be directed to the Rensselaer Libraries.