stable-diffusion-webui 加载 Taiyi-Stable-Diffusion-1B-Chinese-v0.1
软件地址
https://github.com/IDEA-CCNL/stable-diffusion-webui (这个是修改过代码的,可以直接用)
模型地址
https://huggingface.co/IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1/tree/main
报错贴地址
https://huggingface.co/IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1/discussions
https://github.com/IDEA-CCNL/Fengshenbang-LM/issues/186
1.错误
RuntimeError: Error(s) in loading state_dict for LatentDiffusion:
size mismatch for cond_stage_model.transformer.text_model.embeddings.position_ids: copying a param with shape torch.Size([1, 512]) from checkpoint, the shape in current model is torch.Size([1, 77])
这个是 roberta模型,与 CLIP模型不同,SDwebui无法直接调用,需改代码
修改方法
https://github.com/IDEA-CCNL/stable-diffusion-webui/commit/61ece0cec1097ab8f5e2b52c8d340ca203c5917b
2.错误
OSError: Can't load tokenizer for 'IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1/'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1/' is the correct path to a directory containing all relevant files for a BertTokenizer tokenizer.
需要python安装tokenizer,然后下载运行环境
tokenizer环境可以通过PyCharm等软件添加
太乙运行环境下载地址
git clone https://huggingface.co/IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1
把下载好的文件放根目录,新建文件夹IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1
我之前一直报错,就是因为运行环境路径没放对
安装好后的截图

运行程序,示例图


好了,到此为止,可以愉快的玩耍了