SHARP: Shape-Aware Reconstruction of People in Loose Clothing

Sai Sagar Jinka1, Astitva Srivastava1, Chandradeep Pokhariya1, Avinash Sharma1, P. J. Narayanan1
1CVIT, IIIT-H
Paper arXiv Data

SHARP accurately recovers the 3D geometry and appearance of humans in loose clothing from a monocular image

Results

Abstract

Recent advancements in deep learning have enabled 3D human body reconstruction from a monocular image, which has broad applications in multiple domains. In this paper, we propose SHARP (SHape Aware Reconstruction of People in loose clothing), a novel end-to-end trainable network that accurately recovers the 3D geometry and appearance of humans in loose clothing from a monocular image. SHARP uses a sparse and efficient fusion strategy to combine parametric body prior with a non-parametric 2D representation of clothed humans. The parametric body prior enforces geometrical consistency on the body shape and pose, while the non-parametric representation models loose clothing and handle self-occlusions as well. We also leverage the sparseness of the non-parametric representation for faster training of our network while using losses on 2D maps. Another key contribution is 3DHumans, our new life-like dataset of 3D human body scans with rich geometrical and textural details. We evaluate SHARP on 3DHumans and other publicly available datasets and show superior qualitative and quantitative performance than existing state-of-the-art methods.

Method

Dataset

3DHumans dataset provides around 180 meshes of people in diverse body shapes in various garments styles and sizes. We cover a wide variety of clothing styles, ranging from loose robed clothing, like saree (a typical South-Asian dress) to relatively tight fit clothing, like shirts and trousers. Along with the high quality geometry (mesh) and texture map, we also provide registered SMPL's parameters. The faces of the subjects are blurred and smoothened out to maintain privacy.

BibTeX


@article{Jinka2022,
  doi = {10.1007/s11263-022-01736-z},
  url = {https://doi.org/10.1007/s11263-022-01736-z},
  year = {2022},
  month = dec,
  publisher = {Springer Science and Business Media {LLC}},
  author = {Sai Sagar Jinka and Astitva Srivastava and Chandradeep Pokhariya and Avinash Sharma and P. J. Narayanan},
  title = {SHARP: Shape-Aware Reconstruction of People in Loose Clothing},
  journal = {International Journal of Computer Vision}
}