CS231M – Mobile Computer Vision

Syllabus

Lecture	Date	Topic	Instructor
1	3/30/2015	Introduction	Silvio Savarese
2	4/1/2015	Introduction to Android Development Tutorial from the lecture Code from the lecture Android dev tools setup guide	Alejandro Troccoli
3	4/6/2015	Native Android Development + Camera2 API Tutorial from the lecture NDK demo Camera basics demo	Alejandro Troccoli
3	4/6/2015	Project 0 Released	Alejandro Troccoli
4	4/8/2015	Introduction to OpenCV + Eigen + ARM NEON List of OpenCV books accessible online List of vision libraries ARM NEON tutorial from Mozilla Profiling using Instruments on iOS Nvidia's tools for profiling native Android code	Saumitro Dasgupta
5	4/13/2015	Stitching + Blending Image Alignment and Stitching: A Tutorial — Szeliski Computer Vision: Algorithms and Applications — Chapters 4, 5, 9	Kari Pulli
5	4/13/2015	Project 1 Released	Kari Pulli
6	4/15/2015	Panorama + HDR Szeliski, “Computer Vision: algorithms and applications" Chapter 10 Kari Pulli, Marius Tico, Yingen Xiong. Mobile Panoramic Imaging System. 6th IEEE Workshop on Embedded Computer Vision, at CVPR 2010.	Kari Pulli
7	4/20/2015	Optical flow and tracking Forsyth, Ponce “Computer vision: a modern approach”: Chapter 10, Sec 10.6 Chapter 11, Sec 11.1 Szeliski, “Computer Vision: algorithms and applications" Chapter 8, Sec. 8.5 JY. Bouguet, Pyramidal Implementation of the Lucas Kanade Feature Tracker: Description of the algorithm, Tech Report.	Silvio Savarese
8	4/22/2015	Neural networks and decision trees for machine vision A. Criminisi & J. Shotton: Decision Forests Tutorial Rob Fergus: Deep Learning for Computer Vision — Video	Kari Pulli
	4/24/2015	Project 1 Due
	4/26/2015	Project 2 Released
9	4/27/2015	Recognition and Classification Forsyth, Ponce “Computer vision: a modern approach”: Chapter 16, Sec. 16.1 Chapters 6 (sec. 6.2) Szeliski, “Computer Vision: algorithms and applications" Chapter 14, Sec. 14.1, Sec. 14.3, sec. 14.4	Silvio Savarese
10	4/29/2015	Object Detection DPM — Object Detection with Discriminatively Trained Part Based Models Cascade DPM — Cascade Object Detection with Deformable Part Models Sparselets — Generalized Sparselet Models for Real-Time Multiclass Object Recognition Hashing DPM — Fast, Accurate Detection of 100,000 Object Classes on a Single Machine	Hyun Oh Song
11	5/4/2015	Camera + Image Signal Processor Flash applets on some technical aspects of photography The Frankencamera: An Experimental Platform for Computational Photography Android Camera Architecture	Kari Pulli
12	5/6/2015	Inferring 3D geometry from images	Silvio Savarese
	5/8/2015	Project 2 Due
13	5/11/2015	Geotagging and Geospatial Analysis	Amir Zamir
13	5/11/2015	Project Proposal Due	Amir Zamir
14	5/13/2015	Student Paper Presentations — Day 1 Edge boxes: Locating object proposals from edges Zitnick, C. Lawrence, and Piotr Dollár. Computer Vision–ECCV 2014. Springer International Publishing, 2014. 391-405. Topic — Object Proposals. Background Reading: Alexe, B., Deselaers, T., Ferrari, V.: Measuring the objectness of image windows. PAMI 34 (11) (2012) Uijlings, J.R.R., van de Sande, K.E.A., Gevers, T., Smeulders, A.W.M.: Selective search for object recognition. IJCV (2013). Presented by Chung Yu Wang, Sergio Patricio Figueroa Sanz, James Tran Leafsnap: A computer vision system for automatic plant species identification N Kumar, PN Belhumeur, A Biswas, DW Jacobs. ECCV 2012. Topic — Shape classification. Background Reading: Belhumeur, P., Chen, D., Feiner, S., Jacobs, D., Kress, W., Ling, H., Lopez, I., Ramamoorthi, R., Sheorey, S., White, S., Zhang, L.: Searching the world's herbaria: A system for visual identication of plant species. In: ECCV. (2008) Ling, H., Jacobs, D.: Shape classication using the inner-distance. TPAMI 29 (2007) Presented by Jing Pu, Xuan Yang Augmented Faces Matthias Dantone, Lukas Bossard, Till Quack, Luc van Gool Computer Vision–ECCV 2014. Springer International Publishing, 2014. 391-405. Topic — Face detection and AR. Background Reading: Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. IEEE International Conf. on Computer Vision and Pattern Recognition. (2001) 511–518 Z. Stone, T. Zickler, and T. Darrell. Autotagging face-book: Social network context improves photo annotation. In CVPR’08 Presented by Jonathan Noyola, Sean Stanko Face tracking for spatially aware mobile user interfaces Jari Hannuksela, Pekka Sangi, Markus Turtinen and Janne Heikkila. Proceedings of the 3rd international conference on Image and Signal Processing, ICISP ’08. Topic — Face detection and Tracking for HCI. Background Reading: Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. IEEE International Conf. on Computer Vision and Pattern Recognition. (2001) 511–518 T. Ojala, M. Pietikainen, and T. Maenpaa. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. Trans. PAMI, 24(7):971–987, 2002. Presented by Bharad Raghavan
15	5/18/2015	Student Paper Presentations — Day 2 Computer Vision Face Tracking For Use in a Perceptual User Interface G. Bradski Topic — Face Tracking. Background Reading: D. Comaniciu. P. Meer, Robust Analysis of Feature Spaces: Color Image Segmentation. 1997 Presented by Abraham Botros Real-Time Facial Feature Tracking on a Mobile Device P.A. Tresadern, M.C. Ionita, T.F. Cootes IJCV, 2011 Topic — Face tracking using active appearance models. Background Reading: Cootes, T., Edwards, G., & Taylor, C. (2001). Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23 (6), 681–685 Presented by Ruishan Liu, Qi Cao Looking At You: Fused Gyro and Face Tracking for Viewing Large Imagery on Mobile Devices Neel Joshi, Abhishek Kar, Michael Cohen ACM SIGCHI 2012. Topic — Face Tracking for HCI. Background Reading: T Hansen, E Eriksson, Use your head: exploring face tracking for mobile interaction. CHI'06. Presented by Lyne Tchapmi Gesture-based interaction via finger tracking for mobile augmented reality W Hürst, C Van Wezel. Multimedia Tools and Applications, 2013 - Springer. Topic — Gesture recognition Presented by Steven Lee
16	5/20/2015	Student Paper Presentations — Day 3 Mobile visual search Girod, Bernd, et al. Signal Processing Magazine, IEEE 28.4 (2011): 61-76. Topic — Image retrieval. Presented by Vaibhav Aggarwal Outdoors augmented reality on mobile phone using loxel-based visual feature organization. Takacs, Gabriel, et al. ACM international conference on Multimedia information retrieval, 2008. Topic — Localization and AR from a snapshot. Presented by Jiyue Wang, Shaohan Xu, Wei Xia Location coding for mobile image retreival systems S. S. Tsai, D. M. Chen, G. Takacs, V. Chandrasekhar, J. P. Singh, and B. Girod Proc. of International Mobile Multimedia Communications Conference, 2009 Topic — Location coding. Presented by Jeff Han Scalable recognition with a vocabulary tree D. Nister & H. Stewenius CVPR’06 Topic — Vocabulary trees. Presented by Mengyuan Yan
17	5/25/2015	Memorial Day — No Class
18	5/27/2015	Student Paper Presentations — Day 4 Making augmented reality practical on mobile phones — Part 1 + Part 2 D Wagner, D Schmalstieg Computer Graphics and Applications, IEEE Topic — Object detection, tracking and AR. Presented by Kai-Yuan Neo, Mohit Shridhar Pose Tracking from Natural Features on Mobile Phones Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., Schmalstieg, D AIn Proc. of ISMAR 2008, pp. 125-134. Topic — Feature Tracking and camera pose estimation. Presented by Jinhua Xu SURFTrac: Efficient Tracking and Continuous Object Recognition using Local Feature Descriptors Duy-Nguyen Ta CVPR 2009 Topic — Tracking and feature descriptors. Background Reading: Fast keypoint recognition using random ferns. M Ozuysal, M Calonder, V Lepetit, P Fua Presented by Kyunghee Kim Server-side object recognition and client-side object tracking for mobile augmented reality Gammeter, Stephan, et al. Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 Topic — Tracking for mobile augmented reality. Presented by Jordan Thomas Rabet
19	6/1/2015	Project Presentations
20	6/3/2015	Project Presentations
	6/7/2015	Final Project Due — No late days