The Ideal Manager for Computational Imaging
December 10, 2022 | Ni Chen


Computational imaging sits where optical hardware, algorithms and signal processing meet. I have worked in both computer science and optical engineering departments, and I have seen how this mix brings both good chances and real problems. One of the hardest problems is finding managers who can lead people across these fields.

Why the Field Is Cross-Disciplinary

In a traditional imaging system, the optics and the computation are designed separately. In computational imaging they are designed together. This takes more than putting experts in the same room. Someone has to understand how an optical choice changes what the computation needs, and the other way around.

In my work on differentiable imaging [1], real progress often came only when an optical idea shaped the algorithm, or when a computational limit led to a new optical design. So I believe that leading in this field takes more than coordinating separate experts. The manager has to be able to think across the fields.

Optical Hardware

Every computational imaging system starts with light and optics. A manager who knows optical hardware well can make early choices that affect the whole system. This is more than picking lenses or sensors. It means knowing, for example, which aberrations can be corrected in software, or how a diffractive element can encode information for later processing.

Take the trade-off between optical complexity and computing load. A manager who knows optics can help the team find a good balance. Sometimes that means a simpler optical design with a stronger algorithm, instead of chasing perfect optics at a very high cost.

Computation

Computation in imaging is now much more than image enhancement. Modern computational imaging uses machine learning, optimization and inverse problems to recover information that a traditional camera cannot capture. A manager who knows these tools can tell whether a problem calls for deep learning, classical optimization or a physics-based model.

This knowledge matters most when the team tries to improve the system. A manager who understands algorithm complexity, memory use and computing bottlenecks can make sound choices about hardware and system design. They can also help the team through the usual problems of turning a theoretical algorithm into a working system.

Signal and Image Processing

Signal and image processing turns raw sensor data into useful images. A manager with a good grounding in signal processing can judge whether poor image quality comes from the optics, the algorithm or the processing steps.

This helps a lot when debugging. When an artifact shows up, such a manager can lead the team through careful checks to find where it really comes from, instead of patching the symptom.

Communication

Over the years I have seen a steady gap between the optics and the computing communities. Optical engineers talk about point spread functions and aberration coefficients. Computer scientists talk about convergence rates and complexity. This difference in language makes it hard to work together.

A manager who speaks both languages can act as a translator. For example, they can help a computer scientist see why a physical limit cannot just be coded away. This goes beyond words. It means explaining how people in each field think and what they care about.

Keep Learning

The field also changes fast. New optical devices such as metalenses and single-photon detectors keep appearing, and new machine learning and optimization methods come out every month. Fields nearby, such as computer graphics and medical imaging, also bring new ideas.

So a manager has to keep learning, both in their own field and in the fields next to it. In practice this means reading beyond their own conferences and staying in touch with other research communities. A manager who stops learning will lead the team with old assumptions and miss chances.

Building the Team

Beyond technical skill, a manager in computational imaging has to build and grow cross-disciplinary (NOT multi-disciplinary) teams. People from different backgrounds should feel valued, and it should be easy to ask questions across fields.

Good managers in this field often hold regular sessions where team members teach each other the basics of their fields. They pair optical and computational researchers on the same task, so that they learn from each other by working together. Most of all, they show curiosity and humility themselves. Being an expert in one area does not mean there is nothing to learn from others.


Computational imaging keeps changing, and the need for managers with this range of skills will only grow. Areas such as quantum imaging, neural sensors and differentiable optics need even closer links between physical and computational design. Imaging needs are also getting harder, from real-time 3D sensing in self-driving cars to molecular-level resolution in medical devices, so these managers will matter more and more.

To sum up, the ideal manager in computational imaging understands optics, computation and signal processing well enough to make sound choices about the whole system. Just as important, they help people from different fields understand each other and work well together.

Becoming such a manager is not easy. It takes years of study across several fields, and the humility to keep learning. But for those who take on this role, the work is rewarding, both intellectually and in practice.

References

  1. Ni Chen, Liangcai Cao, Ting-Chung Poon, Byoungho Lee, Edmund Y. Lam, “Differentiable Imaging: A New Tool for Computational Optical Imaging,” Advanced Physics Research 2(2), 2023.