Zhigang Zhu


Main Affiliation

Computer Science

Additional Departments/Affiliated Programs

Computer Engineering


North Academic Center







Zhigang Zhu


Dr. Zhu is currently a Herbert G. Kayser Professor of Computer Science, at The City College of New York and The CUNY Graduate Center. He is Director of  the City College Visual Computing Laboratory (CcvcL), and Co-Director of  the Center for Perceptual Robotics, Intelligent Sensors and Machines (PRISM) at CCNY. Previously he has been an Associate Professor at Tsinghua University and a Senior Research Fellow at the University of Massachusetts, Amherst. From 1997 to 1999 he was Director of the Information Processing and Application Division in the Computer Science Department at Tsinghua University. 

Dr. Zhu's research expertise spans the areas of 3D computer vision, human-computer interaction (HCI), augmented reality, video representations, multimodal sensing and processing, and various applications in education, environment, robotics, surveillance, transportation, security inspection, art analysis and assistive technologies. He has published over 130 technical papers in the related fields. Currently he is mainly working with various research issues and applications of computer vision and multimodal sensing, supported by AFOSR, AFRL, ARO, DARPA, NCIIA, NSF,  as well as industry.

In 2012 Dr. Zhu is named the Herbert G. Kayser Chair Professor of Computer Science, a distinction "in recognition of his outstanding achievement as a faculty member in the Grove School of Engineering" at The City College of New York. In May 2013 Professor Zhigang Zhu received President's Award for Excellence, The City College of New York, in the inaugural year of the President's Awards. He is the recipient of CUNY "Certificate of Recognition" yearly from 2004 to now, "Science and Technology Achievement Award" (second prize winner) from Ministry of Electronic Industry China in 1996, "Outstanding Young Teacher in Beijing" in 1997, and "C. C. Lin Applied Mathematics Scholarship" (first prize winner) at Tsinghua in 1997. His Ph.D. thesis " On Environment Modeling for Visual Navigation" was selected in 1999 as a special award in the top 100 dissertations in China over the last three years, and a book based on his Ph.D. thesis was published by China Higher Education Press in December 2001.

He is a senior member of the IEEE, a senior member of the ACM, an Associate Editor of the Machine Vision and Applications Journal (2006 - now), Technical Editor, IEEE/ASME Transactions on Mechatronics (09/2010 - now). He is Co-General Chair of the 2013 IEEE/NSF Workshop on Multimodal and Alternative Perception for Visually Impaired People (MAP4VIP) July 15th, 2013, San Jose, USA ,  Co-General Chair (with Prof. Thomas S. Huang) of the 2007 IEEE Workshop on Multimodal Sentient Computing, in conjunction with CVPR 2007 in Minneapolis, Minnesota, and Co-Guest Editor (with Prof. Takeo Kanade) of Special Issue on Modeling and Representations of Large Scale 3D Scenes, International Journal of Computer Vision.


  • Ph.D. (CS, with honor ), Tsinghua University, China, 1997
  • M.E (CS), Tsinghua University, China, 1991
  • B.E. (CS, with honor), Tsinghua University, China, 1988  

Courses Taught

  • CSC I6716 Computer Vision
  • CSC 21200  Data Structures
  • GC CSc80000 Seminar, 3D Computer Vision and Video Computing
  • CSc 59866/7 Capstone I/II: CS/CpE/EE Joint Senior Design on Smart Living and Assistive Technologies for People in Need
  • GC CSc 83200 , Seminar in Vision, Brain and Assistive Technologies


Research Interests

Computer Vision - Multimodal Sensing - Assistive Technologies - Human Computer Interaction


  1. Edgardo Molina and Zhigang Zhu, Persistent Aerial Video Registration and Fast Multi-view Mosaicing, IEEE Transactions on Image Processing, accepted, March 2014
  2. Edgardo Molina, Alpha Diallo, Zhigang Zhu, Visual Noun Navigation Framework for the Blind, Journal of Assistive Technologies, Vol. 7 Iss: 2, 2013, pp.118 - 130
  3. Wai L. Khoo, Frank Plamer, Joseph Knapp, Zhigang Zhu, Tony Ro, Designing and Testing Wearable Range-Vibrotactile Devices, Journal of Assistive Technologies, Vol. 7 Iss: 2, 2013, pp.102 - 117
  4. T. Wang, Z. Zhu and C. Taylor, A multimodal temporal panorama approach for moving vehicle detection, reconstruction and classification, Computer Vision and Image Understanding, Special Issue on Machine Vision Beyond Visible Spectrum, vol 117, Iss 12, December 2013, pp 1724–1735. http://dx.doi.org/10.1016/j.cviu.2013.02.011.
  5. H. Tang and Z. Zhu, Content-Based 3D Mosaics for Representing Videos of Dynamic Urban Scenes, IEEE Transactions on Circuits and Systems for Video Technology, 22(2), 295-308, 2012. DOI: 10.1109/TCSVT.2011.2178729 .
  6. Rui Li, Nicholas Madampoulos, Zhigang Zhu, and Liangping Xie, Performance comparison of an all-fiber-based laser Doppler vibrometer for remote acoustical signal detection using short and long coherence length lasers, Applied Optics, Vol. 51, Issue 21, pp. 5011-5018 (2012). http://dx.doi.org/10.1364/AO.51.005011
  7. R. Li, T. Wang, Z. Zhu, and W. Xiao, Vibration Characteristics of Various Surfaces Using an LDV for Long-Range Voice Acquisition, IEEE Sensor Journal, vol 11, no 6, June 2011, pp 1415 - 1422
  8. Y. Qu, T. Wang and Z. Zhu, Vision-aided Laser Doppler Vibrometry for Remote Automatic Voice Detection, IEEE/ASME Transactions on Mechatronics, vol 16, no 6.December 2011, pp. 1110-1119
  9. T. Wang, Z. Zhu, E. Blasch, Bio-Inspired Adaptive Hyperspectral Imaging for Target Tracking, IEEE Sensors Journal, Special issue on Enhancement Algorithms, Methodologies & Technology for Spectral Sensing,  vol 10, no 3, March 2010,  pp. 647-654.
  10. Z. Zhu, Sensors in Motion for Security and Surveillance, Journal of Applied Security Research, The Haworth Press, 4:79–100, 2009 (invited paper)
  11. Deepak R. Karuppiah, Roderic A. Grupen, Zhigang Zhu and Allen R. Hanson, Automatic Resource Allocation in a Distributed Camera Network, Machine Vision and Applications, Volume 21, Issue 4 (2010), Page 517-528, http://dx.doi.org/10.1007/s00138-008-0182-7
  12. Zhigang Zhu, Yu-Chi Hu and Li Zhao, Gamma/X-Ray Linear Pushbroom Stereo for 3D Cargo Inspection, Machine Vision and Applications, Volume 21, Issue 4 (2010), Page 413-425, http://dx.doi.org/10.1007/s00138-008-0173-8
  13. Z. Zhu and T. Kanade, Editorial: Modeling and Representations of Large-Scale 3D Scenes, International Journal of Computer Vision, Volume 78, Numbers 2-3 / July, 2008, pp 119-120. http://dx.doi.org/ 10.1007/s11263-008-0128-6
  14. Zhigang Zhu, Allen Hanson, Mosaic-based 3D scene representation and rendering, Signal Processing: Image Communication, Special Issue on Interactive Representation of Still and Dynamic Scenes,  Elsevier, vol 21, no 6, Oct, 2006, pp. 739-754. doi:10.1016/j.image.2006.08.002.
  15. Z. Zhu. G. Xu, E. Riseman and A. Hanson, Fast Construction of Dynamic and Multi-Resolution 360-degree Panoramas from Video Sequences. Image & Vision Computing Journal, Volume 24, Issue 1, 1 January 2006, pp 13-26.
  16. Z. Zhu, E. M. Riseman, A. R. Hanson and H. Schultz, An Efficient Method for Geo-Referenced Video Mosaicing for Environmental Monitoring.  Machine Vision Applications Journal, Springer-Verlag, 16(4): 203-216, 2005.
  17.  Z. Zhu, G. Xu and X. Lin, Efficient Fourier-Based Approach for Detecting Orientations and Occlusions in Epipolar Plane Images for 3D Scene Modeling, International Journal of Computer Vision, 61 (3): 233-258, February - March, 2005.
  18. Z. Zhu, and A. R. Hanson, LAMP: 3D Layered, Adaptive-Resolution and Multi-Perspective Panorama - a New Scene Representation, Computer Vision and Image Understanding, Special Issue on Model-based and Image-based 3D Scene Representation for Interactive Visualization, 96 (3), December 2004, pp 294–326
  19. Z. Zhu, D. R. Karuppiah, E. M. Riseman and A. R. Hanson, Keep Smart, Omnidirectional Eyes on You - Adaptive Panoramic Stereo Vision for Human Tracking with Cooperative Mobile Robots.  Robotics and Automation Magazine, Special Issue on Panoramic Robots, vol 14, no 11, December 2004, pp 69-78
  20.  Z. Zhu, D. Karuppiah, E. M. Riseman and A. R. Hanson, Dynamic Mutual Calibration and View Planning for Cooperative Mobile Robots with Panoramic Virtual Stereo Vision, Computer Vision and Image Understanding, 95 (3), September 2004, pp 261-286.
  21. Z. Zhu, E. M. Riseman, A. R. Hanson, Generalized Parallel-Perspective Stereo Mosaics from Airborne Videos, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 2, Feb 2004, pp 226-237.