cs.CV

Zero-shot monocular depth in 6.1M parameters — "ZipDepth," lightweight depth for any device (ECCV 2026)

cs.CV Fabio Tosi, Luca Bartolomei, Matteo Poggi, et al. (4) Jul 2026

Depth foundation models generalize robustly zero-shot but are too heavy for embedded and mobile platforms; lightweight single-domain alternatives fail silently under domain shift. ZipDepth pairs an efficient reparameterizable encoder-decoder with multi-domain distillation from a foundation model. At 6.1M parameters it runs in real time from server GPUs to power-constrained devices, with the best zero-shot accuracy vs efficiency trade-off among lightweight models on five benchmarks (ECCV 2026).

Paper overview (our summary)

  • Field (arXiv category)cs.CV
  • AuthorsFabio Tosi, Luca Bartolomei, Matteo Poggi, et al. (4)
  • Submitted2026-07-09
  • arXiv ID2607.08771v1

Key points

  • Addresses the gap: depth foundation models are robust but heavy; lightweight models are single-domain and brittle under domain shift
  • Efficient reparameterizable encoder-decoder + large-scale multi-domain knowledge distillation from a foundation model
  • Just 6.1M parameters, real-time from server GPUs to power-constrained devices
  • Best zero-shot accuracy vs deployment-efficiency trade-off among lightweight models across five benchmarks
  • Approaches foundation models with 50x more parameters; ECCV 2026, code released

This work (ZipDepth) advances monocular depth estimation — inferring distance from a single image — on two fronts at once: small enough for constrained devices, and robust enough not to break in unseen domains.

1The gap between foundation models and devices

Monocular depth estimation has progressed rapidly through foundation models. Trained at scale, these models generalize robustly zero-shot to environments they have never seen. But their computational demands put them far beyond what embedded systems and mobile devices can run.

Lightweight alternatives exist, yet they have been developed almost exclusively within single-domain, self-supervised paradigms — so under domain shift they fail silently, returning wrong depth without any error.

2An efficient encoder-decoder design

ZipDepth closes this gap with two combined elements. First, an efficient, reparameterizable encoder-decoder: the network trains in an expressive configuration and folds, via equivalent transformation, into a faster form at inference.

Second, large-scale knowledge distillation from a foundation model over a large multi-domain training set — transferring the generalization ability of the foundation model itself into the compact network, rather than relying on single-domain self-supervision.

3Real-time at 6.1M parameters

The result: at just 6.1M parameters, ZipDepth runs at real-time rates from server GPUs down to power-constrained devices. Across five benchmarks it achieves the best trade-off between zero-shot accuracy and deployment efficiency among lightweight models, taking a significant step toward the accuracy of foundation models with 50x more parameters.

Why it matters

Directly relevant to edge AI and on-device vision. The recipe of distilling foundation-model knowledge into small networks that still generalize is a reference for robotics, AR, and mobile-vision developers, and for anyone tracking model compression.

FAQ

What is monocular depth estimation?
Estimating the distance to each pixel from a single camera image — obtaining 3D information without stereo cameras or LiDAR. It is a core component for robotics, AR, and autonomous driving.
Why does zero-shot matter?
Real devices operate in environments unlike the training data. Lightweight models trained on a single domain break silently in unseen settings, so zero-shot generalization is the key to practical use.

Sources (primary)

Source: arXiv (descriptive metadata is CC0 public domain). Summaries are our own; see arXiv for the original text and PDF.

#AI#arXiv#Research paper#Computer vision#Depth estimation#Edge AI
Disclaimer: This site independently summarizes and classifies information based on official data sources. Always verify the latest and accurate information with the official sources. Content on finance, health, legal, and security is information, not advice. This site is not an official website of the U.S. government.