TripoSR research paper

TripoSR: Fast 3D Object Reconstruction from a Single Image

The official technical report behind TripoSR: a transformer based, feed-forward model that reconstructs a 3D mesh from a single image in under 0.5 seconds. Published on arXiv in March 2024 and released under the MIT license by a collaboration between Stability AI and Tripo AI.

Authors
Dmitry Tochilkin, David Pankratz, Zexiang Liu, Zixuan Huang, Adam Letts, Yangguang Li, Ding Liang, Christian Laforte, Varun Jampani, Yan-Pei Cao
Published
March 4, 2024 (arXiv)
arXiv ID
2403.02151
Subject
Computer Vision and Pattern Recognition (cs.CV)
License
MIT

Abstract

TripoSR is a 3D reconstruction model that uses a transformer architecture for fast feed-forward 3D generation, producing a 3D mesh from a single image in under 0.5 seconds. It builds on the LRM network architecture and adds substantial improvements in data processing, model design, and training techniques. On public datasets it outperforms other open-source alternatives, both quantitatively and qualitatively. It is released under the MIT license to give researchers, developers, and creatives access to current 3D generative AI.

Key contributions

Single image to 3D in under 0.5s

Feed-forward inference produces a full 3D mesh from one image in well under a second on a GPU, with no per-object optimization.

Transformer architecture built on LRM

Extends the Large Reconstruction Model (LRM) design with substantial improvements to data processing, model design, and training.

Open source, MIT licensed

Code and pretrained weights are released under the permissive MIT license, free for research and commercial use.

State of the art among open models

Outperforms other open-source single-image reconstruction methods on public benchmarks, both quantitatively and qualitatively.

Authors

TripoSR is a collaboration between Stability AI and Tripo AI. The technical report lists ten authors:

  • Dmitry Tochilkin
  • David Pankratz
  • Zexiang Liu
  • Zixuan Huang
  • Adam Letts
  • Yangguang Li
  • Ding Liang
  • Christian Laforte
  • Varun Jampani
  • Yan-Pei Cao

How to cite

Use the following BibTeX entry to cite TripoSR in academic work:

@article{TripoSR2024,
  title={TripoSR: Fast 3D Object Reconstruction from a Single Image},
  author={Tochilkin, Dmitry and Pankratz, David and Liu, Zexiang and Huang, Zixuan and Letts, Adam and Li, Yangguang and Liang, Ding and Laforte, Christian and Jampani, Varun and Cao, Yan-Pei},
  journal={arXiv preprint arXiv:2403.02151},
  year={2024}
}

Paper resources

arXiv abstract page

The full technical report, abstract, and author list on arXiv (2403.02151), with PDF and citation export.

Source code on GitHub

The official MIT-licensed implementation at VAST-AI-Research/TripoSR, including run.py and example images.

Model on Hugging Face

The pretrained TripoSR weights and model card at stabilityai/TripoSR, ready to load for inference.

TripoSR paper FAQ

Common questions about the TripoSR technical report. Want to see it in action? Try the free demo and reconstruct a 3D model from an image.

See the paper in action

TripoSR turns a single image into a 3D model in under a second. Try it free in your browser, no install required.