Stephen J. DiVerdi, Ph.D.

(805) 448 5584 2919 Otis St., Berkeley, CA, 94703 stephen.diverdi@gmail.com

Education and Honors

UC Santa Barbara, Santa Barbara, California Fall 2002 - Summer 2007
Received Doctorate in Computer Science for thesis, "Towards Anywhere Augmentation"
Awarded NSF IGERT Digital Multimedia Fellowship
Awarded Computer Science Department Outstanding Teaching Assistant of the Year for 2002-2003
Nominated for campus-wide Outstanding Teaching Assistant of the Year for 2002-2003

Harvey Mudd College, Claremont, California Fall 1998 - Spring 2002
Received Bachelors of Science in Computer Science
Final GPA of 3.54 (Dean's List)
Graduated with honors and departmental high honors
Awarded Harvey S. Mudd Merit Scholarship

Work Experience

Adobe Systems, Inc., San Francisco, California Spring 2015 - present

Principal Scientist - Independent researcher working on designing and implementing state of the art graphics and vision techniques and integrating them into Adobe products. Responsible for full project life-cycle from initial prototype to shipping, for following features / products:

  • Soft Pastel, Ink Brush, and Thick Acrylic brushes in Sketch,
  • Adobe Immersive Environment in Premiere Pro.

Also responsible for coordinating collaboration among researchers and product team members and interacting with users to understand needs and pain points to iterate on UI and motivate future concepts. Windows (Visual Studio) and Mac OS X (Xcode) development in C++, OpenGL/GLSL, CUDA/OpenCL, and SSE. Extensive experience with platform optimization on CPU and GPU.

Google, Mountain View, California Winter 2014 - Spring 2015

Senior Software Engineer - Developer / prototyper in Google [x], working on computational photography. Linux development in C++, halide, and Matlab.

Google, Mountain View, California Fall 2012 - Winter 2014

Senior Software Engineer - Developer on the Google+ Photos team, working on machine learning, image processing, and computer vision. Responsible for design, development, and deployment, from initial concept to shipped feature, for Auto Enhance, using machine learning and image heuristics to automatically adjust uploaded images based on the style of previously edited images. Mentored three junior developers on Google best practices and related projects. Linux and Android development in C++, javascript.

Adobe Systems, Inc., San Jose, California Fall 2007 - Fall 2012

Senior Research Scientist - Independent researcher working on designing and implementing state of the art graphics and vision techniques and integrating them into Adobe products. Responsible for full project life-cycle from initial prototype to shipping, for following features / products:

  • Erodible Tips and Airbrush Tips features in Photoshop CS6,
  • Eazel and Color Lava Photoshop-companion iPad apps,
  • Mixer Brush and Bristle Tips features in Photoshop CS5,
  • Bristle Brush feature in Illustrator CS5.

Also responsible for coordinating collaboration among researchers and product team members and interacting with users to understand needs and pain points to iterate on UI and motivate future concepts. Windows (Visual Studio) and Mac OS X (Xcode) development in C++, OpenGL/GLSL, CUDA/OpenCL, and SSE. Extensive experience with platform optimization on CPU and GPU.

University of California, Santa Barbara, California Fall 2003 - Spring 2007
Research Assistant - Worked on a wide variety of projects in the areas of computer graphics, computer vision, human computer interaction, and multimedia artistic expression. Have worked both individually and on a team, as well as supervising other groups of researchers. Development for Linux with gcc/make/autotools in C and C++, including extensive experience with OpenGL, GPGPU, and OpenCV.

WorldViz, Inc., Santa Barbara, California Fall 2005 - Summer 2007
Software Developer - Design and implementation of image processing and 3D tracking code for real-time multi-camera tracking solution. Both desktop PC development (Windows, Visual Studio) and embedded programming of high-speed cameras (Linux, Eclipse), all in C and C++.

Adobe Systems, Inc., San Jose, California Summer 2003
Advanced Technology Group, Intern - Summer project investigating capabilities of programmable graphics hardware, as applied to non-graphics computations. Detailed analysis of performance related issues, as well as theoretical limitations. Development for Windows using Visual Studio, in C++, NVIDIA Cg, and OpenGL.

Harvey Mudd College, Claremont, California Summer 2002
Software Developer - Designed, implemented, tested, and documented a suite of instructional graphics programs for undergraduate course curriculum. Responsible for complete development cycle. Software was used in Computer Graphics courses for 2002 - 2006 academic years. Developed for Linux using gcc/make/autotools and OpenGL.

Researcher - Two student, nine month research project. Design and development of advanced photorealistic rendering technique derived from progressive radiosity. Project is online at http://www.cs.hmc.edu/~sdiverdi/radiosity/

United Devices, Austin, Texas Fall 2001 - Spring 2002
Senior Project, Team Leader - Industry-sponsored project at Harvey Mudd College. Ported biomedical applications PHYLIP and RepeatMasker to massively distributed parallel framework. Directed team of four students, responsible for organization, scheduling, division of labor and progress reporting. Developed in C and PERL for Linux.

Adobe Systems, Inc., San Jose, California Summer 2000, Summer 2001
Advanced Technology Group, Intern - Participated in design and implementation of next generation rich media file format. Responsible for font handling and embedded multimedia content. Developed for Windows using Visual Studio in C++.

Mail2World, Inc., Claremont, California Fall 2000
Software Developer - Designed and implemented a web based, multi-lingual email client. Developed in Java for cross-platform applets.

Publications

[69] S. Liu, M. Agrawala, S. DiVerdi, A. Hertzmann. "ZoomShop: Depth-Aware Editing of Photographic Composition." In Computer Graphics Forum (Proceedings of Eurographics), 41(2), May 24, 2022.

[68] X. Yu, S. DiVerdi, A. Sharma, Y. Gingold. "ScaffoldSketch: Accurate Industrial Design Drawing in VR." In Proceedings of UIST, Oct. 10-14, 2021.

[67] R. Suzuki, R. Kazi, L.-Y. Wei, S. DiVerdi, W. Li, D. Leithinger. "RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic Sketching." In Proceedings of UIST, Oct. 20-23, 2020. Honorable Mention Award

[66] J. Hartmann, S. DiVerdi, C. Nguyen, D. Vogel. "View-dependent effects for 360° virtual reality video." In Proceedings of UIST, Oct. 20-23, 2020.

[65] B. T. Kumaravel, C. Nguyen, S. DiVerdi, B. Hartmann. "TransceiVR: Bridging Asymmetrical Communication Between External and VR Users." In Proceedings of UIST, Oct. 20-23, 2020.

[64] K. Lin, Z. Xu, B. Mildenhall, P. Srinivasan, Y. Hold-Geoffroy, S. DiVerdi, Q. Sun, K. Sunkavalli, R. Ramamoorthi. "Deep Multi Depth Panoramas for View Synthesis." In Proceedings of ECCV, Aug. 23-27, 2020.

[63] Y. Zhang, Z. Zhang, S. DiVerdi, Z. Wang, J. Echevarria, Y. Fu. "Texture Hallucination for Large-Factor Painting Super-Resolution." In Proceedings of ECCV, Aug. 23-27, 2020.

[62] R. Montano-Murillo, C. Nguyen, R. Kazi, S. Subramanian, S. DiVerdi, D. Martinez-Plasencia. "Slicing Volume: Hybrid 3D/2D Multi target Selection Technique for Dense Virtual Environments." In Proceedings of IEEE Virtual Reality, Mar. 22-26, 2020.

[61] S. Liu, M. Agrawala, S. DiVerdi, A. Hertzmann. "View-Dependent Video Textures for 360° Video." In Proceedings of UIST, Oct. 20-23, 2019.

[60] S. DiVerdi, J. Lu, J. Echevarria, M. Shugrina. "Generating Playful Palettes from Images." In Proceedings of Expressive, May 5-6, 2019.

[59] C. Nguyen, S. DiVerdi. "Designing communication add-ons for VR applications using VR-embedded Widgets." In Proceedings of the Challenges Using Head-Mounted Displays in Shared and Social Spaces Workshop at CHI, May 5, 2019.

[58] B. T. Kumaravel, C. Nguyen, S. DiVerdi, B. Hartmann. "TutoriVR: A Video-Based Tutorial System for Design Applications in Virtual Reality." In Proceedings of SIGCHI, May 4-9, 2019.

[57] A. Serrano, I. Kim, Z. Chen, S. DiVerdi, D. Gutierrez, A. Hertzmann, B. Masia. "Motion parallax for 360° RGBD video." In IEEE Virtual Reality, Mar. 23-27, 2019. Best Journal Paper Nominee.

[56] Y.-C. Tung, S. DiVerdi, A. Hertzmann, J. Wobbrock. "Comparing Spatial Interaction Modalities for 2D-Widgets in Productivity Applications in Virtual Reality." Technical Report UW-CSE-18-10-01, University of Washington, 2018.

[55] E. Balashova, A. Bermano, V. Kim, S. DiVerdi, A. Hertzmann, T. Funkhouser. "Learning a stroke-based representation for fonts." In Computer Graphics Forum, Oct. 5, 2018.

[54] J. Brecha, M. Lukác, Z. Chen, S. DiVerdi, M. Cadík. "Immersive Trip Reports." In Proceedings of UIST, Oct. 14-18, 2018.

[53] J. Tan, S. DiVerdi, J. Lu, Y. Gingold. "Pigmento: Pigment-based image analysis and editing." In Transactions on Visualization and Computer Graphics, Jul. 23, 2018.

[52] C. Nguyen, S. DiVerdi, A. Hertzmann, F. Liu. "Depth Conflict Reduction for Stereo VR Video Interfaces." In Proceedings of SIGCHI, Apr. 21-26, 2018.

[51] A. Saeedi, M. Hoffman, S. DiVerdi, A. Ghandeharioun, M. Johnson, R. Adams. "Multimodal Prediction and Personalization of Photo Edits with Deep Generative Models." In Proceedings of AISTATS, Apr. 9-11, 2018.

[50] C. Nguyen, S. DiVerdi, A. Hertzmann, F. Liu. "CollaVR: Collaborative In-Headset Review for VR Video." In Proceedings of UIST, Oct. 22-25, 2017.

[49] Z. Jin, G. Mysore, S. DiVerdi, J. Lu, A. Finkelstein. "VoCo: Text-based Insertion and Replacement in Audio Narration." In Proceedings of SIGGRAPH, Jul. 30-Aug. 3, 2017.

[48] M. Shugrina, J. Lu, S. DiVerdi. "Playful Palette: An Interactive Parametric Color Mixer for Artists." In Proceedings of SIGGRAPH, Jul. 30-Aug. 3, 2017.

[47] J. Tan, S. DiVerdi, J. Lu, Y. Gingold. "Pigmento: Pigment-based Image Analysis and Editing." arXiv:1707.08323, Jul. 26, 2017.

[46] A. Saeedi, M. Hoffman, S. DiVerdi, A. Ghandeharioun, M. Johnson, R. Adams. "Multimodal Prediction and Personalization of Photo Edits with Deep Generative Models." arXiv:1704.04997, Apr. 17, 2017.

[45] C. Nguyen, S. DiVerdi, A. Hertzmann, F. Liu. "Vremiere: In-Headset Virtual Reality Video Editing." In Proceedings of SIGCHI, May 6-11, 2017. Best Paper Honorable Mention.

[44] Z. Jin, A. Finkelstein, S. DiVerdi, J. Lu, G. Mysore. "CUTE: A Concatenative Method for Voice Conversion Using Exemplar-based Selection." In Proceedings of ICASSP, Mar. 20-25, 2016.

[43] S. DiVerdi, J. Barron. "Geometric Calibration for Mobile, Stereo, Autofocus Cameras." In Proceedings of WACV, Mar. 8-10 2016.

[42] H. Chen, O. Fried, Y. Liu, S. DiVerdi, A. Finkelstein. "Palette-based Photo Recoloring." In Proceedings of SIGGRAPH, Aug. 9-13, 2015.

[41] O. Fried, S. DiVerdi, M. Halber, E. Sizikova, A. Finkelstein. "IsoMatch: Creating Informative Grid Layouts." In Computer Graphics Forum (Proceedings of Eurographics) 34(2), May 2015.

[40] S. DiVerdi. "A Modular Framework for Digital Painting." In Transactions on Visualization and Computer Graphics, Vol. 21, No. 7, Jul. 2015.

[39] M. Benjamin, S. DiVerdi, A. Finkelstein. "Painting with Triangles." In Non Photorealistic Animation and Rendering, Aug. 8-10, 2014.

[38] J. Lu, S. DiVerdi, W. Chen, C. Barnes, A. Finkelstein. "RealPigment: Paint Compositing by Example." In Non Photorealistic Animation and Rendering, Aug. 8-10, 2014. Best Paper Award.

[37] K. Chaudhury, S. DiVerdi, S. Ioffe. "Auto-rectification of User Photos." In the International Conference on Image Processing, Oct. 27-30, 2014.

[36] J. Lu, C. Barnes, S. DiVerdi, A. Finkelstein. "RealBrush: Painting with Examples of Physical Media." In Proceedings of SIGGRAPH, Jul. 21-25, 2013.

[35] V. Kim, W. Li, N. Mitra, S. Chaudhuri, S. DiVerdi, T. Funkhouser. "Learning Part-based Templates from Large Collections of 3D Shapes." In Proceedings of SIGGRAPH, Jul. 21-25, 2013.

[34] S. DiVerdi, A. Krishnaswamy, R. Mech, D. Ito. "Painting with Polygons: A Procedural Watercolor Engine." In Transactions on Visualization and Computer Graphics, Vol. 19, No. 5, May, 2013.

[33] S. DiVerdi. "A Brush Stroke Synthesis Toolbox." In P. Rosin and J. Collomosse (Eds.), Image and Video-Based Artistic Stylisation, Springer, 2013.

[32] J. Lu, F. Yu, A. Finkelstein, S. DiVerdi. "HelpingHand: Example-based Stroke Stylization." In Proceedings of SIGGRAPH, Aug. 5-9, 2012.

[31] V. Kim, W. Li, N. Mitra, S. DiVerdi, T. Funkhouser. "Exploring Collections of 3D Models using Fuzzy Correspondences." In Proceedings of SIGGRAPH, Aug. 5-9, 2012.

[30] S. DiVerdi, A. Krishnaswamy, R. Mech, D. Ito. "A Lightweight, Procedural, Vector Watercolor Paint Engine." In the Symposium on Interactive 3D Graphics and Games, Mar. 9-11, 2012. Best Paper Award.

[29] S. DiVerdi, A. Krishnaswamy, S. Hadap. "Industrial-Strength Painting with a Virtual Bristle Brush." In the Symposium on Virtual Reality Software and Technology, Nov. 22-24, 2010.

[28] S. Hadap, S. DiVerdi, A. Krishnaswamy. "Industrial-Strength Painting with a Bristle Brush Simulation." In Non Photorealistic Animation and Rendering, Jun. 7-10, 2010.

[27] J. Ventura, S. DiVerdi, T. Höllerer. "A sketch-based interface for photo pop-up." In Sketch-Based Interfaces and Modeling, Aug. 1-2, 2009.

[26] J. Wither, S. DiVerdi, T. Höllerer. "Annotation in Outdoor Augmented Reality." In Computers and Graphics, Vol. 33, No. 6, December 2009.

[25] I. Rakkolainen, T. Höllerer, S. DiVerdi, A. Olwal. "Mid-air display experiments to create novel user interfaces." In Multimedia Tools and Applications, Vol. 44, No. 3, September, 2009.

[24] S. DiVerdi, J. Wither, T. Höllerer. "All Around the Map: Online Spherical Panorama Construction." In Computers and Graphics, Vol. 33, No. 1, February, 2009.

[23] C. Lee, S. DiVerdi, T. Höllerer. "Depth-Fused 3D Imagery on an Immaterial Display." In Transactions on Visualization and Computer Graphics, Vol. 15, No. 1, January, 2009.

[22] S. DiVerdi, T. Höllerer. "Heads Up and Camera Down: A Vision-Based Tracking Modality for Mobile Mixed Reality." In Transactions on Visualization and Computer Graphics, Vol. 14, No. 3, May/June, 2008.

[21] S. DiVerdi, J. Wither, T. Höllerer. "Envisor: Online Environment Map Construction for Mixed Reality," In IEEE Virtual Reality, Mar. 8-12, 2008. Best Paper Honorable Mention.

[20] A. Olwal, S. DiVerdi, I. Rakkolainen, T. Höllerer. "Consigalo: Multi-user Face-to-face Interaction on Immaterial Displays," In the International Conference on Intelligent Technologies for Interactive Entertainment, Jan. 8-10, 2008.

[19] J. Wither, S. DiVerdi, T. Höllerer. "Evaluating Display Types for AR Selection and Annotation." In the International Symposium on Mixed and Augmented Reality, Nov. 13-16, 2007.

[18] C. Lee, S. DiVerdi, T. Höllerer. "An Immaterial Depth-Fused 3D Display." In the Symposium on Virtual Reality Software and Technology, Nov. 5-7, 2007. Best Student Paper Award.

[17] S. Kim, S. DiVerdi, J. Chang, T. Kang, R. Iltis, T. Höllerer. "Implicit 3D Modeling and Tracking for Anywhere Augmentation." In the Symposium on Virtual Reality Software and Technology, Nov. 5-7, 2007.

[16] S. DiVerdi, A. Olwal, I. Rakkolainen, and T. Höllerer. "An Immaterial Pseudo-3D Display with 3D Interaction." In H. M. Ozaktas and L. Onural (Eds.), Three-Dimensional Television: Capture, Transmission, and Display, Springer, 2007.

[15] T. Höllerer, J. Wither and S. DiVerdi. "Anywhere Augmentation: Towards Mobile Augmented Reality in Unprepared Environments." In G. Gartner, M.P. Peterson, and W. Cartwright (Eds.), Location Based Services and TeleCartography, Series: Lecture Notes in Geoinformation and Cartography, Springer Verlag, 2007.

[14] S. DiVerdi, T. Höllerer. "GroundCam: A Tracking Modality for Mobile Mixed Reality." In IEEE Virtual Reality, Mar. 10-14, 2007. Best Paper Honorable Mention.

[13] J. Wither, S. DiVerdi, T. Höllerer. "Using Aerial Photographs for Improved Mobile AR Annotation." In the International Symposium on Mixed and Augmented Reality, Oct. 22-25, 2006.

[12] S. Fleck, F. Busch, P. Biber, W. Strasser, I. Rakkolainen, S. DiVerdi, T. Höllerer. "3DTV - Panoramic 3D Model Acquisition and Its 3D Visualization on the Interactive FogScreen." In the International Conference on Image Processing Special Session on 3DTV: Extraction, Representation, Compression and Transmission, Oct. 8-11, 2006.

[11] S. DiVerdi, T. Höllerer. "Image-space Correction of AR Registration Errors Using Graphics Hardware." In IEEE Virtual Reality, Mar. 25-29, 2006.

[10] A. Olwal, S. DiVerdi, N. Candussi, I. Rakkolainen, T. Höllerer. "An Immaterial, Dual-sided Display System with 3D Interaction." In IEEE Virtual Reality, Mar. 25-29, 2006.

[9] S. DiVerdi, I. Rakkolainen, T. Höllerer, A. Olwal. "A novel walk-through 3D display." In Stereoscopic Displays and Virtual Reality Systems XIII, Jan. 2006.

[8] S. DiVerdi, T. Höllerer. "Image-space Correction of AR Registration Errors Using Graphics Hardware." Technical Report UCSB//CSD-05-06, University of California at Santa Barbara, 2005.

[7] S. DiVerdi, N. Candussi, T. Höllerer. "Real-time Rendering with Wavelet-Compressed Multi-Dimensional Datasets on the GPU." Technical Report UCSB//CSD-05-05, University of California at Santa Barbara, 2005.

[6] S. DiVerdi, T. Höllerer. "Combining Dynamic Physical and Virtual Illumination in Augmented Reality." Technical Report UCSB//CSD-04-28, University of California at Santa Barbara, 2004.

[5] S. DiVerdi, T. Höllerer, R. Schreyer. "Level of Detail Interfaces in an Augmented Reality Application Environment." In the International Symposium on Mixed and Augmented Reality, Nov. 2-5, 2004.

[4] S. DiVerdi. "Real-Time Photorealistic Rendering for Augmented Reality in Unprepared Environments." In the Doctoral Colloquium of the joint International Symposia on Wearable Computers and Mixed and Augmented Reality, Nov. 2, 2004. Best Paper Award.

[3] S. DiVerdi, D. Nurmi, T. Höllerer. "A Framework for Generic Inter-Application Interaction for 3D AR Environments." In The Second IEEE International Augmented Reality Toolkit Workshop, Oct. 7, 2003.

[2] S. DiVerdi, D. Nurmi, T. Höllerer. "ARWin - A Desktop Augmented Reality Window Manager." In the International Symposium on Mixed and Augmented Reality, Oct. 7-10 2003.

[1] S. DiVerdi, D. Nurmi, T. Höllerer. "ARWin - A Desktop Augmented Reality Window Manager." Technical Report UCSB//CSD-03-12, University of California at Santa Barbara, 2003.


Patents

  • 11,783,534 3D Simulation of a 3D Drawing in Virtual Reality
  • 11,776,232 Virtual 3D Pointing and Manipulation
  • 11,574,450 Systems for Augmented Reality Sketching
  • 11,562,169 Generating Multimodal Image Edits
  • 11,551,384 Flow-based Color Transfer from Source Graphic to Target Graphic
  • 11,539,932 Dynamically Generating and Changing View-Specific-Filter Parameters for 360-Degree Videos
  • 11,532,106 Color Gradient Capture from Source Image Content
  • 11,328,458 Guided Generation of Color Gradients via Adjustable Color Map Paths through Color Space Elements of Graphical Interfaces
  • 11,288,771 Texture Hallucination for Large-scale Image Super-resolution
  • 11,281,351 Selecting Objects within a Three-dimensional Point Cloud Environment
  • 11,182,932 Color Gradient Capture From Source Image Content
  • 11,178,374 Dynamically Rendering 360-degree Videos Using View-specific-filter Parameters
  • 11,107,257 Systems and Methods of Generating Playful Palettes from Images
  • 11,087,503 Interactive Color Palette Interface for Digital Painting
  • 11,074,918 Systems for Augmented Reality Sketching
  • 11,050,994 Virtual Reality Parallax Correction
  • 11,048,335 Stroke Operation Prediction for Three-Dimensional Digital Content
  • 11,043,012 Flow-based Color Transfer from Source Graphic to Target Graphic
  • 11,030,796 Interfaces and Techniques to Retarget 2D Screencast Videos into 3D Tutorials in Virtual Reality
  • 10,957,063 Dynamically Modifying Virtual and Augmented Reality Content to Reduce Depth Conflict Between User Interface Elements and Video Content
  • 10,949,057 Position-dependent modification of descriptive content in a virtual reality environment
  • 10,930,021 Guided Generation of Color Gradients via Adjustable Color Map Paths Through Color Space Elements of Graphical Interfaces
  • 10,924,633 RGB-based Parametric Color Mixing System for Digital Painting
  • 10,803,642 Collaborative Virtual Reality Anti-Nausea and Video Streaming Techniques
  • 10,791,412 Particle-based Spatial Audio Visualization
  • 10,754,529 Facilitating Editing of Virtual-Reality Content Using a Virtual-Reality Headset
  • 10,701,334 Virtual Reality Parallax Correction
  • 10,701,431 Handheld controller gestures for virtual reality video playback
  • 10,671,238 Position-dependent modification of descriptive content in a virtual reality environment
  • 10,627,910 Stroke Operation Prediction for Three-Dimensional Digital Content
  • 10,613,703 Collaborative Interaction with Virtual Reality Video
  • 10,592,776 Generating Multimodal Image Edits for a Digital Image
  • 10,575,119 Particle-based Spatial Audio Visualization
  • 10,477,185 Systems and methods for multiscopic noise reduction and high-dynamic range
  • 10,347,238 Text-based Insertion and Replacement in Audio Narration
  • 10,347,012 Interactive Color Palette Interface for Digital Painting
  • 10,217,253 Methods and apparatus for simulation of a stateful brush tip in a natural media drawing and/or painting simulation
  • 10,187,628 Systems and methods for multiscopic noise reduction and high-dynamic range
  • 10,169,893 Optimizing photo album layouts
  • 10,165,388 Particle-based spatial audio visualization
  • 10,109,083 Local optimization for curvy brush stroke synthesis
  • 9,762,893 Systems and methods for multiscopic noise reduction and high-dynamic range
  • 9,639,956 Image adjustment using texture mask
  • 9,483,138 Natural media painting using a realistic brush and tablet stylus gestures
  • 9,424,671 Optimizing photo album layouts
  • 9,330,340 Noise estimation for images using polynomial relationship for pixel values of image features
  • 9,268,418 Simulation of an erodible tip in a natural media drawing and/or painting simulation
  • 9,256,950 Detecting and modifying facial features of persons in images
  • 9,251,567 Providing color corrections to photos
  • 9,064,309 Automatic rectification of distortions in images
  • 9,013,485 Systems and methods for synthesizing high fidelity stroke data for lower dimension input strokes
  • 8,994,698 Methods and apparatus for simulation of an erodible tip in a natural media drawing and/or painting simulation
  • 8,917,283 Polygon processing techniques in procedural painting algorithms
  • 8,917,282 Separating water from pigment in procedural painting algorithms
  • 8,896,579 Methods and apparatus for deformation of virtual brush marks via texture projection
  • 8,854,342 Systems and methods for particle-based digital airbrushing
  • 8,830,242 Realistic real-time simulation of brush behavior
  • 8,760,438 System and method for simulating stiff bristle brushes using stiffness-height parameterization
  • 8,749,572 System and method for simulation of brush-based painting in a color space that includes a fill channel
  • 8,665,258 Generating a depth map based on a single image
  • 8,654,143 System and method for non-uniform loading of digital paint brushes
  • 8,605,095 Generating vector output from a physical simulation of a bristle brush
  • 8,599,213 System and method for simulating paint brush strokes using configurable wetness, drying, and mixing parameters
  • 8,462,173 System and method for simulation of paint deposition using a pickup and reservoir model
  • 8,379,047 System and method for creating stroke-level effects in bristle brush simulations using per-bristle opacity
  • 8,335,675 Realistic real-time simulation of natural media paints
  • 8,219,370 Simulation of shallow viscoelastic flows

Interns Supervised

2022 - Ana Cardenas Gasca, Ph.D. student at UC Santa Barbara

2022, 2020 - Xue Yu, Ph.D. student at George Mason University

2021 - Cory Ilo, Ph.D. student at Virginia Tech

2021 - Jack Atherton, Ph.D. student at Stanford University

2021 - Tianyi Wang, Ph.D. student at Purdue University

2021 - Jiahao Li, Ph.D. student at UC Los Angeles

2020, 2018 - Sean Liu, Ph.D. student at Stanford University

2019 - Jeremy Hartmann, Ph.D. student at University of Waterloo

2019 - Xinyi Li, Ph.D. student at Temple University

2019 - Yulun Zhang, Ph.D. student at Northeastern University

2019 - Kai-En Lin, Ph.D. student at UC San Diego

2019 - Ryo Suzuki, Ph.D. student at CU Boulder - now an assistant professor at University of Calgary

2019 - Shm Almeda, undergraduate at the College of New Jersey - now a Ph.D. student at UC Berkeley

2018 - Bala Kumaravel, Ph.D. student at UC Berkeley

2018 - Roberto Antonio Montano Murillo, Ph.D. student at University of Sussex - now a research fellow at University College London

2018 - Hema Susmita Padala, undergraduate at Oregon State University - now a technical program manager at Microsoft

2017 - Ana Serrano, Ph.D. student at Universidad de Zaragoza - now an assistant professor at the Defense University Center in Zaragoza

2017 - Sharath Adavanne, Ph.D. student at Tampere University of Technology - now a senior research scientist at Zapr Media Labs

2017 - Ying-Chao (Tony) Tung, Ph.D. student at University of Washington - now a Software Engineer at Asana

2017 - Rose Meacham, Ph.D. student at University of Illinois at Urbana-Champaign

2016 - Cuong Nguyen, Ph.D. student at Princeton University - now a Research Scientist at Adobe

2016, 2015 - Zeyu Jin, Ph.D. student at Princeton University - now a Research Scientist at Adobe

2016 - Elena Sizikova, Ph.D. student at Princeton University - now an Assistant Professor at New York University

2016 - Ardavan Saeedi, Ph.D. student at Massachusetts Institute of Technology - now at Butterfly Network, Inc.

2016 - Jianchao Tan, Ph.D. student at George Mason University - now a Research Scientist at Kwai Inc.

2016 - Jun Xing, Ph.D. student at University of Hong Kong - now a Research Scientist at miHoYo

2013 - Ohad Fried, Ph.D. student at Princeton University - now an assistant professor at The Interdisciplinary Center Herzliya

2012, 2011 - Jingwan (Cynthia) Lu, Ph.D. student at Princeton University - now a Research Scientist at Adobe

2012, 2011 - Vladimir Kim, Ph.D. student at Princeton University - now a Research Scientist at Adobe

2010 - Taehee Lee, Ph.D. student at University of California, Los Angeles - now a Software Engineer at Google

2008 - Jonathan Ventura, Ph.D. student at University of California, Santa Barbara - now an Assistant Professor at California Polytechnic State University, San Luis Obispo


Activities

Spring 2022 - Program Committee - User Interface Software and Technology Symposium, 2022 - ACM.

Fall 2021 - Best Paper Co-chair - User Interface Software and Technology Symposium, 2021 - ACM.

Spring 2021 - Program Committee - User Interface Software and Technology Symposium, 2021 - ACM.

Winter 2019 - Guest Editor - Computers & Graphics - Elsevier.

Fall 2019 - Technical Briefs and Posters Committee - SIGGRAPH Asia, 2019 - ACM.

Fall 2019 - Associate Chair - SIGCHI, 2020 - ACM.

Spring 2019 - Program Committee - User Interface Software and Technology Symposium, 2019 - ACM.

Winter 2018 - Papers Co-chair - Expressive, 2019 - Eurographics.

Fall 2018 - International Program Committee - Virtual Reality, 2019 - IEEE.

Fall 2018 - Program Committee - Symposium on Virtual Reality Software and Technology - ACM.

Spring 2018 - Program Committee - User Interface Software and Technology Symposium - ACM.

Fall 2017 - International Program Committee - Virtual Reality, 2018 - IEEE.

Winter 2016 - International Program Committee - Symposium on Geometry Processing - Eurographics.

Winter 2014 - Industry Co-chair - ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games - ACM.

Spring 2014 - Program Committee - Expressive, the Joint Symposium on Computational Aesthetics, Sketch-based Interfaces and Modeling, and Non-photorealistic Animation and Rendering - ACM / Eurographics.

Summer 2013 - Work In Progress Chair - International Symposium on Mixed and Augmented Reality - IEEE / ACM

Spring 2013 - Program Committee - Expressive, the Joint Symposium on Computational Aesthetics, Sketch-based Interfaces and Modeling, and Non-photorealistic Animation and Rendering - ACM / Eurographics.

Spring 2013 - Program Committee - Symposium on Interactive 3D Graphics and Games - ACM

Summer 2012 - Program Committee - International Symposium on Mixed and Augmented Reality - IEEE / ACM

Summer 2011 - Area Chair - International Symposium on Mixed and Augmented Reality - IEEE / ACM

Summer 2011 - Virtual Reality Chair - International Symposium on Visual Computing, 2011 - Springer LNCS

Summer 2010 - Program Committee - Symposium on 3D User Interfaces, 2010 - IEEE

Summer 2008 to Summer 2010 - Program Committee - International Symposium on Mixed and Augmented Reality, 2008, 2009, 2010 - IEEE / ACM

Summer 2009 to Summer 2010 - Program Committee - Symposium on Virtual Reality Software and Technology, 2009, 2010 - ACM

Summer 2009 to Summer 2010 - Program Committee - International Symposium on Visual Computing, 2009, 2010 - Springer LNCS

Winter 2008 - Exhibits Co-Chair - Virtual Reality, 2009 - IEEE

Fall 2006 to Spring 2007 - President - Computer Science Graduate Representatives - UC Santa Barbara

Fall 2006 - Student Research Colloquium Chair - International Symposium on Mixed and Augmented Reality, 2006 - IEEE / ACM

Summer 2006 - Program Chair - Graduate Student Research Colloquium, 2006 - UC Santa Barbara

Fall 2005 to Fall 2006 - Local Arrangements Chair - International Symposium on Mixed and Augmented Reality, 2006 - IEEE / ACM

Spring 2005 to Spring 2007 - Committee Member - Outstanding Teaching Assistant Award Committee - UC Santa Barbara

Fall 2004 to Fall 2006 - Treasurer - Computer Science Graduate Representatives - UC Santa Barbara

Spring 2003 to Spring 2007 - Computer Science Department Representative - Graduate Student Assembly - UC Santa Barbara

Fall 2001 to Spring 2002 - Social and Activities Planning Committee Chair - Associated Students of Harvey Mudd College - Harvey Mudd College

Fall 2001 to Spring 2002 - Student Faculty Liaison - Computer Science Department - Harvey Mudd College


Teaching Experience

UC Santa Barbara, Santa Barbara, California Fall 2002 - Spring 2007
Teaching Assistant -
  Fall 2006 - GCMPS 280 Real-time Computer Graphics (graduate level)
  Spring 2006 - GCMPS 595i Seminar: SIGGRAPH 2005 Review (graduate level)
  Winter 2006 - CMPS 190i Human Computer Interaction
  Spring 2005 - GCMPS 595i Seminar: SIGGRAPH 2004 Review (graduate level)
  Spring 2005 - GCMPS 280 Real-time Computer Graphics (graduate level)
  Spring 2004 - GCMPS 595b Seminar: SIGGRAPH 2003 Review (graduate level)
  Winter 2004 - GCMPS 280 Computer Graphics (graduate level)
  Spring 2003 - CMPS 170 Operating Systems
  Winter 2003 - CMPS 176B Network Computing
  Fall 2002 - CMPS 180 Computer Graphics
Lectures -
  Oct 24, 2006 - Differential Equations for Computer Graphics (for GCMPS 280)
  Oct 5, 2006 - Cg Programming and Introduction to Shading and Illumination (for GCMPS 280)
  Oct 3, 2006 - OpenGL Programming and the Programmable Hardware Pipeline (for GCMPS 280)
  Oct 4, 2005 - OpenGL Programming and Basic 3D Interaction Primer (for GCMPS 290i - 3D User Interfaces)
  May 6, 2005 - Multipass Rendering and Projective Texturing (for GCMPS 280)
  Apr 8, 2005 - Practical Cg Programming (for GCMPS 280)
  Apr 1, 2005 - OpenGL Programming Primer (for GCMPS 280)
  Nov 29, 2004 - Introduction to the STL (for CMPS 60 - UNIX/C/C++)
  Feb 3, 2004 - OpenGL Programming Primer (for GCMPS 280)
  Jan 15, 2004 - Mathematics for Computer Graphics (for GCMPS 280)
  May 14, 2003 - Hardware Input/Output (for CMPS 170)
Outreach -
  Mar 11, 2010 - Harvey Mudd College Colloquium, "Industrial Strength Natural Media Painting Simulation"
  Oct 4, 2007 - Lecture, "The Future of Computing", for Media and Communication class at Berkeley City College
  Jan 30, 2007 - LEAPS visit, lab workshop for local eight grade science class
  Dec 7, 2006 - Harvey Mudd College Colloquium, "Recent Progress in Mobile Augmented Reality"
  Nov 16, 2006 - Cal Poly San Luis Obispo Visit, introduction to grad student life and research at UCSB
  Mar 4, 2006 - Los Ingenieros / MESA Science and Technology Day, lab workshop for local high school students
  Mar 5, 2005 - Los Ingenieros / MESA Science and Technology Day, lab workshop for local high school students
  Nov 30, 2004 - LEAPS visit, lab workshop for local eight grade science class
  Aug 22, 2004 - STEP Academic Head Start Program, introduction to grad school seminar for incoming freshman
  Apr 24, 2004 - Los Ingenieros / MESA Science and Technology Day, lab workshop for local high school students
  Dec 12, 2003 - LEAPS visit, lab workshop for local eight grade science class

Harvey Mudd College, Claremont, California Spring 2002
Science, Technology and Society of Science Fiction - Taught discussion-based literature seminar course, supervised by faculty member. Class of ten students. Organized curriculum, led discussions, evaluated students' participation and writing.

Demos

Project Sidewinder. In Adobe MAX Sneaks, Oct. 18-20 2017. Las Vegas, NV. YouTube

Project Clover. In Adobe MAX Sneaks, Nov. 2-4 2016. San Diego, CA. YouTube

Adobe Premiere Pro. In Kaleidoscope Showcase Vol. 1, Sep. 30 2016. San Francisco, CA.

The Interactive FogScreen. In 2057: The City, Jan. 28, 2007. Discovery Channel. YouTube

The Interactive FogScreen. In ACM Multimedia, Oct. 23-26 2006. Santa Barbara, CA.

Using Aerial Photographs for Improved Mobile AR Annotation. In the International Symposium on Mixed and Augmented Reality, Oct. 22-25, 2006. Santa Barbara, CA.

Sound Putty. In Music and the Moving Image, Jan. 14-15, 2006. Santa Barbara, CA.

The Interactive FogScreen. In SIGGRAPH Emerging Technologies, Jul. 31-Aug. 4 2005. Los Angeles, CA.

HandVu. In the joint International Symposia on Wearable Computers and Mixed and Augmented Reality, Nov. 2-5, 2004. Washington D.C.