PetAvatar: Pet Avatar Customized and Animated Generation via Diffusion Model

Khoury College of Computer Science, University of Northeastern University


Statics Results from Different Customized Diffusion Models.

Animiated Results from Different Customized Diffusion Models.

Comparison

Pet

w/o LoRA(Image)

w/o LoRA(Video)

w/ LoRA(Image)

w/ LoRA(Video)

Compare output results of pre-trained sdxl model and sdxl model with LoRA from the same input prompt.

Gallery

Golden Retreiver

user input pet images
static results
animated results

Hiromi

user input pet images
static results
animated results

Maltipoo

user input pet images
static results
animated results

Border Collie

user input pet images
static results
animated results

Bull

user input pet images
static results
animated results

Duberman

user input pet images
static results
animated results

Dachshund

user input pet images
static results
animated results

Abyssinian

user input pet images
static results
animated results

Bengal

user input pet images
static results
animated results

British Shorthair Golden

user input pet images
static results
animated results

British Shorthair Sliver

user input pet images
static results
animated results

Maine

user input pet images
static results
animated results

Ragdoll

user input pet images
static results
animated results

BibTeX

      
    @article{guo2023animatediff,
      title={AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning},
      author={Guo, Yuwei and Yang, Ceyuan and Rao, Anyi and Liang, Zhengyang and Wang, Yaohui and Qiao, Yu and Agrawala, Maneesh and Lin, Dahua and Dai, Bo},
      journal={International Conference on Learning Representations},
      year={2024}
    }

    @article{ruiz2022dreambooth,
      title={DreamBooth: Fine Tuning Text-to-image Diffusion Models for Subject-Driven Generation},
      author={Ruiz, Nataniel and Li, Yuanzhen and Jampani, Varun and Pritch, Yael and Rubinstein, Michael and Aberman, Kfir},
      booktitle={arXiv preprint arxiv:2208.12242},
      year={2022}
    }

    @article{DBLP:journals/corr/abs-2106-09685,
      author       = {Edward J. Hu and
                      Yelong Shen and
                      Phillip Wallis and
                      Zeyuan Allen{-}Zhu and
                      Yuanzhi Li and
                      Shean Wang and
                      Weizhu Chen},
      title        = {LoRA: Low-Rank Adaptation of Large Language Models},
      journal      = {CoRR},
      volume       = {abs/2106.09685},
      year         = {2021},
      url          = {https://arxiv.org/abs/2106.09685},
    }