I am interested in solving real world problems using computer vision and machine learning. At Adobe, I work on research and tech transfer projects related to deep learning, image processing and intelligent systems. Before joining Adobe, I studied computer vision with Prof. Stan Sclaroff at Boston University and got my PhD in 2016.
[CV] [Google Scholar] [LinkedIn] [My Old Website]
Contact: jianmzha AT adobe.com
News
- [04/04/2019] Our code for single image shallow DoF is released [code]
- [03/15/2019] Two papers accepted at CVPR 2019.
- [03/15/2019] Our paper SmartEye received Best Paper Honorable Mention at CHI.
- [02/06/2019] Received Adobe’s Tech Excellence Award with three other amazing colleagues.
- [01/01/2019] One paper on Layout GAN gets accepted at ICLR.
- [01/01/2019] One paper on Mobile Composition Guidance gets accepted at CHI.
- [10/11/2018] The Content Aware Fit and Content Aware Crop feature are shipped in InDesign CC and Illustrator CC (Demo). I developed the key auto cropping technology behind these features.
- [09/17/2018] Our paper on pointer networks for sequence analysis accepted at NeurIPS.
- [08/11/2018] Our paper on multi-touch guesture control for drone photography will be presented at IROS 2018.
- [08/11/2018] Our paper on shallow DoF effect form a single image gets accepted at Siggraph Asia.
- [07/04/2018] Three papers get accepted at ECCV.
Selected Publications
PhD Thesis
- Visual Saliency Computation for Image Analysis. Boston University, 2016. [PDF]
Books
- Jianming Zhang, Filip Malmberg, Stan Sclaroff. “Visual Saliency: From Pixel-Level to Object-Level Analysis”. Springer, 2019. [Pub]
Journals
- Hao Kang, Haoxiang Li, Jianming Zhang, Xin Lu, Bedrich Benes, “FlyCam: Multi-touch Gesture Controlled Drone Gimbal Photography”. IEEE Robotics and Automation Letters, 2018. (selected to be presented at IROS 2018, Spain) [Pub]
- Yuqiu Kong, Jianming Zhang, Huchuan Lu, Xiuping Liu, “Exemplar-aided Salient Object Detection via Joint Latent Space Embedding”. IEEE Transactions on Image Processing, 2018. [Pub]
- Danna Gurari, Kun He, Bo Xiong, Jianming Zhang, Mehrnoosh Sameki, Suyog Dutt Jain, Stan Sclaroff, Margrit Betke, Kristen Grauman. “Predicting Foreground Object Ambiguity and Efficiently Crowdsourcing the Segmentation (s)”. International Journal of Computer Vision (IJCV), 2018. [Pub] [arXiv]
- Jianming Zhang, Sarah Adel Bargal, Zhe Lin, Xiaohui Shen, Jonathan Brandt, Stan Sclaroff. “Top-down Neural Attention by Excitation Backprop”. International Journal of Computer Vision (IJCV), 2018. [Pub] [Project Page]
- Jianming Zhang, Shugao Ma, Mehrnoosh Sameki, Stan Sclaroff, Margrit Betke, Zhe Lin, Xiaohui Shen, Brian Price and Radomír Měch. “Salient Object Subitizing”. International Journal of Computer Vision (IJCV), 2017. [Pub] [Project Page]
- Shugao Ma , Jianming Zhang, Leonid Sigal, Nazli Ikizler-Cinbis and Stan Sclaroff. “Space-Time Tree Ensemble for Action Recognition”. International Journal of Computer Vision (IJCV), 2017. [Pub]
- Shugao Ma, Sarah Adel Bargal, Jianming Zhang, Leonid Sigal, Stan Sclaroff. “Do Less and Achieve More: Training CNNs for Action Recognition Utilizing Action Images from the Web”. Pattern Recognition, 2017. [arXiv] [Project Page]
- Jianming Zhang and Stan Sclaroff. “Exploiting Surroundedness for Saliency Detection: A Boolean Map Approach”. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2016. [PDF] [Supp] [Project Page]
Conferences
- Lu Zhang, Jianming Zhang, Zhe Lin, Huchuan Lu, You He. “CapSal: Leveraging Captioning to Boost Semantics for Salient Object Detection”. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
- Siyuan Qiao, Zhe Lin, Jianming Zhang, and Alan Yuille. “Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization”. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
- Shuai Ma, Zijun Wei, Feng Tian, Xiangmin Fan, Jianming Zhang, Xiaohui Shen, Zhe Lin, Jin Huang, Radomír Měch, Dimitris Samaras, Hongan Wang. “SmartEye: Assisted Instant Photo Taking via the Integration of User Preferences into the View Proposal Network”. In ACM CHI Conference on Human Factors in Computing Systems Proceedings (CHI), 2019. (Best Paper Honorable Mention)
- Jianan Li, Jimei Yang, Aaron Hertzmann, Jianming Zhang and Tingfa Xu. “LayoutGAN: Generating Graphic Layouts with Wireframe Discriminator”. In Proc. International Conference on Learning Representations (ICLR), 2019.
- Zijun Wei, Boyu Wang, Minh Hoai, Jianming Zhang, Xiaohui Shen, Zhe Lin, Radomir Mech and Dimitris Samaras. “Sequence-to-Segment Networks for Segment Detection”. In Proc. Advances in Neural Information Processing Systems (NeurIPS), 2018.
- Lijun Wang, Xiaohui Shen, Jianming Zhang, Oliver Wang, Zhe Lin, Chih-Yao Hsieh, Sarah Kong, Huchuan Lu. “DeepLens: Shallow Depth Of Field From A Single Image”. In Proc. Siggraph Asia, 2018. [PDF] [Project Page] [code]
- Wei-Chih Hung, Jianming Zhang, Xiaohui Shen, Zhe Lin, Joon-Young Lee,Ming-Hsuan Yang. “Learning to Blend Photos”. In Proc. European Conference on Computer Vision (ECCV), 2018. [PDF] [Project Page]
- Rameswar Panda, Jianming Zhang, Haoxiang Li, Joon-Young Lee, Xin Lu, Amit Roy-Chowdhury, “Contemplating Visual Emotions: Understanding and Overcoming Dataset Bias”. In Proc. European Conference on Computer Vision (ECCV), 2018. [PDF] [Project Page]
- Yufei Wang, Zhe Lin, Xiaohui Shen, Scott Cohen, Jianming Zhang. “ConceptMask: Large-Scale Segmentation from Semantic Concepts”. In Proc. European Conference on Computer Vision (ECCV), 2018.
- Zijun Wei, Jianming Zhang, Min Hoai, Xiaohui Shen, Zhe Lin, Radomir Mech and Dimitris Samaras. “Good View Hunting: Learning Photo Composition from Dense View Pairs”. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. [PDF] [Project Page]
- Sarah Adel Bargal*, Andrea Zunino*, Donghyun Kim, Jianming Zhang, Vittorio Murino, Stan Sclaroff. “Excitation Backprop for RNNs.” In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. [PDF] [Code]
- Filip Malmberg, Robin Strand, Jianming Zhang, Stan Sclaroff. “The Boolean Map Distance: Theory and Efficient Computation”. In Proc. International Conference on Discrete Geometry for Computer Imagery (DGCI), 2017. [Pub]
- Vasili Ramanishka, Abir Das, Jianming Zhang, Kate Saenko. “Top-down Visual Saliency Guided by Captions”. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017. [PDF] [Project Page]
- Jianming Zhang, Zhe Lin, Jonathan Brandt, Xiaohui Shen, Stan Sclaroff. “Top-down Neural Attention by Excitation Backprop”. In Proc. European Conference on Computer Vision (ECCV), 2016. (oral) [PDF] [Supp] [Project Page]
- Jianming Zhang, Stan Sclaroff, Zhe Lin, Xiaohui Shen, Brian Price and Radomír Měch. “Unconstrained Salient Object Detection via Proposal Subset Optimization”. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. (spotlight) [PDF] [Supp] [Project Page]
- Jianming Zhang, Stan Sclaroff, Zhe Lin, Xiaohui Shen, Brian Price and Radomír Měch. “Minimum Barrier Salient Object Detection at 80 FPS”. In Proc. IEEE International Conference on Computer Vision (ICCV), 2015. (oral) [PDF] [Project Page]
- Jianming Zhang, Shugao Ma, Mehrnoosh Sameki, Stan Sclaroff, Margrit Betke, Zhe Lin, Xiaohui Shen, Brian Price and Radomír Měch. “Salient Object Subitizing”. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015. [PDF] [Supp] [Project Page]
- Jianming Zhang, Shugao Ma and Stan Sclaroff. “MEEM: Robust Tracking via Multiple Experts using Entropy Minimization”. In Proc. European Conference on Computer Vision (ECCV), 2014. [PDF] [Supp] [Project Page]
- Jianming Zhang and Stan Sclaroff. “Saliency Detection: A Boolean Map Approach”. In Proc. IEEE Internetional Conference on Computer Vision (ICCV), 2013. [PDF] [Project Page]
- Shugao Ma, Jianming Zhang, Nazli Ikizler-Cinbis and Stan Sclaroff. “Action Recognition and Localization by Hierarchical Space-Time Segments”. In Proc. IEEE Internetional Conference on Computer Vision (ICCV), 2013. [PDF] [Project Page]
- Jianming Zhang, Liliana Lo Presti and Stan Sclaroff, “Online Multi-Person Tracking by Tracker Hierarchy”. In Proc. IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS), 2012. [PDF] [Project Page]
Patents
- Large-scale image tagging using image-to-topic embedding (US 10216766B2)
- Semantic Class Localization in Images (US 9846840)
- Generating Image Features Based on Robust Feature-Learning (US 9830526)
- Accurate Tag Relevance Prediction for Image Search (Pending, International)
- Image Zooming (US 9805445)
- Image Cropping Suggestion Using Multiple Saliency Maps (US 9626584)
- Saliency Map Computation (US 9454712)
Honors and Awards
- Best Paper Honorable Mention, CHI 2019
- Technical Excellence Award, Adobe 2019
- Outstanding Reviewer, CVPR 2017
Tech Transfer Highlights
- Conten Aware Fit in InDesign CC 2019 [Youtube]. The key technology behind this is an automatic image cropping algorithm we started to develop years ago. Since then, the algorithm went through several iterations and I was the main developer for the latest version.
- Select Subject in Photoshop CC 2018 [Youtube]. Deep learning based salient object detection with high boundary accuracy. This is one of the first few Sensei powered features in Adobe flagship products. I designed and developed the deep learning algorithm behind this feature. Media coverage: [PetaPixel], [TechCrunch], [Engaget].
- Auto Selection in Photoshop Elements 2018 [Youtube]. Deep learning based interactive image segmentation. I designed and developed the deep learning algorithm behind this feature.
Former Interns
- He Zhang, Rutgers University, 2018
- Haichao Yu, UIUC, 2018
- Kang Hao, Purdue University, 2018
- Lijun Wang, Dalian University of Technology, 2017.
- Jianan Li, Beijing Institute of Technology, 2017.
- Zhe Wang, UC Irvine, 2017.
- Rameswar Panda, UC Riverside, 2017.
- Wei-Chih (Wayne) Hung, UC Merced, 2017.
- Zijun Wei, Stony Brook University, 2017, 2018.