HyperMeeting, Hypervideo, Video Editing

HyperMeeting

Invented the concept of hyper-meetings as time-shifted video conferences organized as video connected by hyperlinks. Created a web-based video conferencing app with server-based recording that can play previously recording meetings synchronized across the participants of the current meeting.

Technical challenges. Created a web-based video conferencing system using WebRTC and signalling with WebSocket. Implemented client-side video recording with upload to a web server. Implemented server-side recording with an open-source WebRTC media server to address performance issues with client-side recording. Implemented playback of previously recording videos, including the following of hyperlinks between meetings, with HTML video tags, JavaScript, and a timeline drawn in an HTML canvas. Synchronized video playback across meeting participants via a WebSocket protocal.

Technologies. WebRTC, WebRTC Media Server, WebSocket, Node.js, JavaScript, HTML Canvas, HTML Video, Amazon Mechanical Turk (for evaluation).

A. Girgensohn, J. Marlow, F. Shipman, L. Wilcox. Guiding Users Through Asynchronous Meeting Content With Hypervideo Playback Plans. Hypertext, 49-59, doi:10.1145/2914586.2914597, 2016.
A. Girgensohn, J. Marlow, F. Shipman, L. Wilcox. HyperMeeting: Supporting Asynchronous Meetings With Hypervideo. ACM Multimedia, 611-620, doi:10.1145/2733373.2806258, 2015.
L. Denoue, S. Carter, A. Girgensohn, M. Cooper. Building Digital Project Rooms for Web Meetings. Document Engineering, 135-138, doi:10.1145/2644866.2644889, 2014.

Hypervideo

Developed an editor and video player for a form of hyper video where video providing additional detail is linked to a video segment. Users may choose to watch the linked video that is spliced into the main video being watched. Created a system for automatically generating video summaries in the form of multi-level hypervideo where each level provides additional detail.

Technical challenges. Created video player controls with link-following capabilities as Java applets that control either Windows Media Player or QuickTime plugins via JavaScript. Developed a hypervideo editor as 2D workspace in a Java applet. Devised an algorithm for automatically summarizing a video as a multi-level hypervideo.

Technologies. Java, Swing, JavaScript, Windows Media Player, QuickTime.

F. Shipman, A. Girgensohn, L. Wilcox. Authoring, Viewing, and Generating Hypervideo: An Overview of Hyper-Hitchcock. ACM Transactions on Multimedia Computing, Communications and Applications, 5(2), doi:10.1145/1413862.1413868, 2009.
F. Shipman, A. Girgensohn, L. Wilcox. Hypervideo Expression: Experiences With Hyper-Hitchcock. ACM Conference on Hypertext and Hypermedia, 217-226, doi:10.1145/1083356.1083401, 2005.
A. Girgensohn, L. Wilcox, F. Shipman, S. Bly. Designing Affordances for the Navigation of Detail-On-Demand Hypervideo. Working Conference on Advanced Visual Interfaces (AVI), 290-297, doi:10.1145/989863.989913, 2004.
F. Shipman, A. Girgensohn, L. Wilcox. Generation of Interactive Multi-Level Video Summaries. ACM Multimedia. 392-401, doi:10.1145/957013.957096, 2003.
F. Shipman, A. Girgensohn, L. Wilcox. Hyper-Hitchcock: Towards the Easy Authoring of Interactive Video. Human-Computer Interaction INTERACT, 33-40, 2003.
A. Girgensohn, F. Shipman, L. Wilcox. Hyper-Hitchcock: Authoring Interactive Videos and Generating Interactive Summaries. ACM Multimedia. 92-93, doi:10.1145/957013.957030, 2003.
F. Shipman, A. Girgensohn, L. Wilcox. Combining Spatial and Navigational Structure in the Hyper-Hitchcock Hypervideo Editor. Hypertext, 124-125, doi:10.1145/900051.900078, 2003.

Hitchcock Video Editor

Designed and developed an easier way for video editing by dividing video into clips based on quality considerations such as camera motion. Created an editor implemented as a Java applet that supported the user in browsing through these clips, arranging some of them in a timeline, and adjusting clip durations by resizing the keyframe.

Technical challenges. Developed a C++ DirectShow app that retrieved video from a DV camcorder, analyzed it for motion and other features, and transcoded it into a video format suitable for playback. Designed and implemented a Java applet for displaying keyframes of video clips as image stacks sorted by different criteria and for arranging video clips along a timeline. Developed a C++ app that took the edit decision list together with an optional audio track to produce a new video file.

Technologies. Java, Swing, Windows Media Player, C++, DirectShow filter graph, DV video.

L. Wilcox, J. Doherty, A. Girgensohn. A Hitchcock Assisted Video Edited Night at the Opera. ACM Multimedia, 2002.
A. Girgensohn, S. Bly, F. Shipman, J. Boreczky, L. Wilcox. Home Video Editing Made Easy - Balancing Automation and User Control. Human-Computer Interaction (INTERACT), 464-471, 2001.
A. Girgensohn, J. Boreczky, P. Chiu, J. Doherty, J. Foote, G. Golovchinsky, S. Uchihashi, L. Wilcox. A Semi-Automatic Approach to Home Video Editing. UIST, 81-89, doi:10.1145/354401.354415, 2000.