欢迎光临散文网 会员登陆 & 注册

【AI绘画】极乐disco,生成油画风你需要知道的一切

2023-04-13 22:07 作者:向内生长_  | 我要投稿

这次测试的是极乐disco风格的lora模型。

极乐disco是一款来自爱沙尼亚(现总部英国伦敦)ZA/UM游戏工作室的CRPG类游戏,以独特的叙事风格,画风与音乐著称。当然,毕竟我们讨论的主要是AI绘画,所以无关绘画的部分就不过多赘述。

关于极乐disco的画风,它主要源自俄罗斯绘画历史上最伟大的画派——巡回画派,巡回画派的基本主张是:坚持车尔尼雪夫斯基“美就是生活”的艺术思想,反对俄罗斯艺术上的西欧化,强调民族特点,以反映本国人民的生活与人民的苦难为自己的责任。

故而在极乐disco的美术风格中也贯彻了这一主张,提倡现实主义,画面粗犷、笔触奔放、色彩大胆。

下载链接

大模型下载链接:https://pan.baidu.com/s/1DS8oAkpOVmM6O7_n6gIjNwhttps://pan.baidu.com/s/1DS8oAkpOVmM6O7_n6gIjNw

提取码:0m2p


lora:

https://pan.baidu.com/s/1-WNDnvh7sO5O-LnDhEN6pQhttps://pan.baidu.com/s/1-WNDnvh7sO5O-LnDhEN6pQ

提取码:0f1c


视频链接

【AI绘画】极乐disco油画画风,你需要知道的一切


先说结论

极乐disco大模型在画面表现非常不错,一些写实风格ckpt大模型环境下甚至可能融合出意想不到的效果。但兼容性较差,若是想用它还原一些人物,需要小型的调整权重。在图生图的风格迁移方面表现令人惊喜,不过在提示词方面需要注意写的更详细一些。

日常使用权重建议:0.8~1.0

人物生成权重建议:0.4~0.8

图生图风格迁移时,权重建议:0.8~1.25  重绘幅度建议:0.4~0.5

测试使用的模型

大模型

(以下简称A)revAnimated

(以下简称B)Dosmix_

(以下简称C)anything-v4.5

无预览图

(以下简称D)realisticVisonV20

(以下简称E)fiveNutsMixedMix_v10

lora

DiscoElysiumStyle

实际使用案例

大模型(ckpd):revAnimated

Lora:DiscoElysiumStyle 权重:1

Step:40 /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:512x823

正:

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar,

Soft Lighting,strong rim light,(close-up:1.3),

1 man,drunkoak,  on desk, (depressed:0.7),cigarette, sitting, face,ready to draw,

(black coat, shotgun, holster, sling, bleeding, short hair, beard, (blowing smoke),Cowboy hat),

desk , ceiling fan , open window,

dusk, The City Outside the Window,

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

大模型(ckpd):revAnimated

Lora:DiscoElysiumStyle 权重:1

Step:40 /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:512x823

正:

masterpiece, best quality, 8k, oil painting, soft lighting,ZaUm, elysiumChar,colorful, detailed and intricate,

Soft Lighting,strong rim light, Tyndall effect,Looking towards the sun,

1 man, (lever action, revolver), (cowboy:0.6),blood on bandages, injury,

cowboy boots, cowboy hat, denim jacket, spurs, whiskers, exhausted,

brown horse,

farm,Colorful Sky,cloud, dusk, exhaust, tree,

against fence,over shoulder,

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

大模型(ckpd):revAnimated

Lora:DiscoElysiumStyle 权重:1

Step:40 /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:1204x720

开启高清修复

放大算法:潜变量  /  重绘幅度:0.4  /  高清修复采样次数:0  /  放大倍率:1.2

正:

masterpiece, best quality, 8k, oil painting, soft lighting,ZaUm, elysiumChar,colorful, scenery,,detailed and intricate,

(Heavy Industry Factory,Iron making plant ,  (smokestack), machinery, ruins, crowd,railroad crossing, railroad tracks, train), crane \(machine\), cargo pallet, people,

exhaust, winter, cumulonimbus cloud

sunset, cumulonimbus cloud

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

大模型(ckpd):revAnimated

Lora:DiscoElysiumStyle 权重:1.25

图生图模式

Step:40 /  CFG Scale:7  / Sampler : DPM++ SDE  a Karras /   分辨率:720x512

重绘幅度:0.4

正:

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar,colorful, detailed and intricate,

People

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

大模型(ckpd):revAnimated

Lora:DiscoElysiumStyle 权重:1.25

图生图模式

Step:40 /  CFG Scale:7  / Sampler : DPM++ SDE  a Karras /   分辨率:720x512

重绘幅度:0.65

正:

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar,colorful, detailed and intricate,

train, railroad tracks, tree,railing,exhaust,

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

CKPT大模型测试

人物生成测试

测试不同权重的极乐disco lora在不同大模型环境下的人物生成表现。

大模型(ckpd):revAnimated

Lora:DiscoElysiumStyle 权重:1

Step:40 /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:512x512

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar , face ,  portrait, (close-up:1.2),

Soft Lighting,strong rim light,

1 man,standing, (angry:0.5), lever action,

sombrero, (coat on shoulders), black shirt, blowing smoke,

city,pine tree , cliff, rising sun, cumulonimbus cloud,

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

对比图

场景生成测试

测试不同权重的极乐disco lora在不同大模型环境下的场景生成表现。

大模型(ckpd):revAnimated

Lora:DiscoElysiumStyle 权重:1

Step:25 /  CFG Scale:9  / Sampler : DPM++ SDE  a Karras /   分辨率:720x512

正:

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm , elysiumChar , colorful, scenery,,detailed and intricate,

(Heavy Industry Factory,Iron making plant ,  (smokestack), machinery, ruins, crowd,railroad crossing, railroad tracks, train), crane \(machine\), cargo pallet, people,

exhaust, winter, cumulonimbus cloud

sunset, cumulonimbus cloud

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

对比图



结论

图中的横轴为CKPT大模型,从A到E依次排列,纵轴为极乐disco lora的权重,从0.8到1.1。

在无论从人物还是场景,都可以看出,极乐disco lora的兼容能力。并且在一些情况下融合成了独特的画风。

A,E模型都是相对平面的画风,在此环境下生成的作品则比较忠于原始画风。

B,D模型则为相对立体的画风,其中D为完全的真实照片风格,在此环境下则融合诞生出了一种更加强调色彩与线条的全新风格



lora兼容性测试

测试不同权重的极乐disco lora在不同大模型环境下的场景生成表现。

人物lora兼容性测试

大模型(ckpd):revAnimated

Lora:DiscoElysiumStyle

Lora:genshinImpactNoelle

Step:25 /  CFG Scale:7  / Sampler :   /   分辨率:700x700

正:

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar ,  portrait,

Soft Lighting,strong rim light,

1girl,hair ornamen, gloves,  gilded frame, ganyu, twin horn, bare shoulder, bodysuit,

noelle_\(genshin_impact\), 1girl,(green_eyes:1.2//),silver hair, short_hair, medium_breasts, rose, red_flower,hair_flower, <lora:genshinImpactNoelle_nV1:NUM>

city,pine tree,cliff, rising sun, cumulonimbus cloud,

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

对比图:



服装lora兼容性测试

基础参数

Lora:DiscoElysiumStyle

lora:hanfu_v29

Step:25  /  CFG Scale:7  / Sampler : DPM++ 2S  a Karras /   分辨率:512x512

Seed:4260405912

正:

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar ,  portrait,

floating hair,chromatic aberration, bowdepth of field,monochrome,

(1girl, solo),

hanfu,song,

strong rim light,upper body

wind, autumn, maple leaf, falling leaves, blurry background, day, ginkgo leaf, depth of field,

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

对比图


结论

原神诺艾尔测试中,横轴为人物lora的权重,从0.4到0.8以0.1递进。纵轴为极乐disco画风lora,从0.4到0.8以0.1递进。

汉服lora测试中,横轴为汉服lora权重,从0.4到0.8以0.1递进。纵轴为极乐disco画风lora,从0.6到1.0以0.1递进。其中权重偏差为额外测试所得,超出该范围可能导致画面崩溃。

在测试过程中,明显感觉对人物lora兼容性稍差,在无数次调整后确认权重在0.4到0.8之间才能有比较好的画面效果,并且使用人物lora时需要稍大的画幅,不然可能会导致面部崩溃。

汉服lora则出现了一些盖过原画风的问题,因为再开大权重可能导致面部变形,所以也无法通过改变权重解决问题。不过在画面融合时依然产生了一些有趣的效果,也是一种不错的尝试。



图生图改变画风

人物肖像图生图

基础参数

Lora:DiscoElysiumStyle

Step:30   /  CFG Scale:7  / Sampler : DPM++ 2S  a Karras /   分辨率:720x556

Denoising: 0.4

Seed:470772336

正:

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar , face ,  portrait, (close-up:1.2),

Soft Lighting,strong rim light,blurry background,

1man,old man,asian,straw hat, white shirt, farmer ,tree

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,


测试不同权重与不同重绘幅度的影响

对比图

横轴为重绘幅度,从0.35到0.55,以0.05为递进。

纵轴为lora权重,从0.8到1.4,以0.15递进。



基础参数

Lora:DiscoElysiumStyle

Step:30   /  CFG Scale:7  / Sampler : DPM++ 2S  a Karras /   分辨率:720x556

Seed:105519802

正:

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar , face ,  portrait, (full body:1.2),

Soft Lighting,strong rim light,blurry background,

1 girl , asian , sitting , basket, kakiman, tree, stone, against rock,

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

测试不同权重与不同重绘幅度的影响

对比图

横轴为重绘幅度,从0.35到0.55,以0.05为递进。

纵轴为lora权重,从0.8到1.4,以0.15递进。


场景图生图

基础参数

Lora:DiscoElysiumStyle

Step:30   /  CFG Scale:7  / Sampler : DPM++ 2S  a Karras /   分辨率:720x556

Seed:105519802

正:

masterpiece, best quality, 8k, oil painting, soft lighting , ZaUm, elysiumChar , face ,  scenery,

Soft Lighting,

village, building, fog, hill, chinese building,

负:

(low quality, worst quality:1.4), (monochrome, dof:1.2), easynegative, bad anatomy, bad hand, extra digits, extra fingers, twisted fingers, long body, jpeg artifacts, signature, watermark, username, censor, text,

测试不同权重与不同重绘幅度的影响

对比图

横轴为重绘幅度,从0.35到0.55,以0.05为递进。

纵轴为lora权重,从0.8到1.4,以0.15递进。


结论

在人物肖像方面的表现让人惊喜,在稍低重绘幅度情况下完整的保留了极乐disco风格的笔触,对原始人物面部有轻微影响。在稍高重绘幅度情况下则偏向模型的训练集风格,人物开始偏向西方人种特征,即便提示词中已经有了相关的提示。

人物全身的生成方面则有些差强人意,虽然画风依然保留,但已经完全看不出原始人物特征,低重绘幅度情况下人脸崩溃情况严重,开高重绘又会极大降低还原度。具体使用时可以参控测试结果进行取舍。

场景方面则非常惊喜,无论是最开始对场景的还原,抑或是高重绘情况下对场景“极乐disco”化改造。都展现出了不俗的可能性,给了我不少灵感。在后续其他测试中,我也可能会尝试用白模场景进行生成,看看它基于有限构图的创作能力。

交流群

QQ: 697080799

VX:



【AI绘画】极乐disco,生成油画风你需要知道的一切的评论 (共 条)

分享到微博请遵守国家法律