FLUX12B震撼发布:SD创始团队黑马出手,直出完美手指,23G迄今最大开源文生图模型

FLUX12B震撼发布:SD创始团队,超越MJ&DALL-E,23G迄今最大开源文生图模型

??大家好!欢迎来到破狼公众号。感谢大家的支持与鼓励。在AIGC探索道路上,我将与你一路同行。喜欢就星标关注破狼公众号或文末扫码加入交流群 !

FLUX模型简介

官方演示案例

FLUX模型简介

8月1这天开源文生图模型迈入了有一个大里程碑,黑森林实验室(一家已完成3100万美元的种子轮系列融资)的12B文生图大模型:FLUX震撼发布。这是迄今为止最大的文生图开源模型。这也是目前高质量的文生图模型,FLUX.1文生图模型套件,为文本到图像合成定义了新的最先进水平,在图像细节、提示遵循、风格多样性和场景复杂性方面树立了新的基准标准。在可访问性和模型能力之间取得平衡,FLUX.1一共有三个变体:FLUX.1 [pro]、FLUX.1 [dev] 和 FLUX.1 [schnell]:

  • ? FLUX.1 [dev] :基础模型,开源且拥有非商业许可,供社区在此基础上进行构建。https://huggingface.co/black-forest-labs/FLUX.1-dev/tree/main

  • ? FLUX.1 [schnell] :基本模型的精简版本,蒸馏版本,23.8 GB,运行速度最高可提高 10 倍。Apache 2 许可。https://huggingface.co/black-forest-labs/FLUX.1-schnell/blob/main/flux1-schnell.sft

  • ? FLUX.1 [pro] :官方闭源版本,可以通过 API提供服务使用。API地址:https://replicate.com/black-forest-labs/flux-pro、https://docs.bfl.ml/

FLUX模型评估

FLUX.1 [pro] 和 [dev] 在以下每个方面超越了流行的模型,如 Midjourney v6.0DALL·E 3(HD)和 SD3-Ultra:视觉质量、提示遵循、尺寸/方面变化、排版和输出多样性。FLUX.1 [schnell] 是迄今为止最先进的几步模型,不仅超越了其同类竞争对手,还超越了像 Midjourney v6.0 和 DALL·E 3(HD)这样的强大非蒸馏模型。FLux模型专门针对预训练中保持整个输出多样性进行了微调。与当前的最先进技术相比,它们提供了显著改进的可能性,如下所示。

所有FLUX.1模型变体都支持 0.1 和 2.0 百万像素的多种纵横比和分辨率,如下例所示。

FLUX.1 支持的纵横比和分辨率示例

另外黑森林实验室团队提到在Flux文生图模型之后,计划会进一步进军文生视频领域。不久的将来我们可能会在文生视频领域的重大里程碑震撼发布。

Flux模型体验

Flux ComfyUI安装

ComfyUI的最新版本已支持Flux模型的运行,仅需将ComfyUI更新到最新版本即可。ComfyUI官方文档:https://comfyanonymous.github.io/ComfyUI_examples/flux/。

  • ? 需要下载模型Flux1-schnell.sft放置到目录ComfyUI/models/unet/ 下。下载地址:https://huggingface.co/black-forest-labs/FLUX.1-schnell/blob/main/flux1-schnell.sft。显存不足24,尽量采用8为量化版本:https://hf-mirror.com/maximsobolev275/flux-fp8-schnell/resolve/main/flux1-schnell_fp8_unet.safetensors?download=true

  • ? 需要下载VAE模型ae.sft放置到目录ComfyUI/models/vae 下。下载地址:https://huggingface.co/black-forest-labs/FLUX.1-schnell/blob/main/ae.sft

  • ? 需要下载T5文本编码模型t5xxl_fp8_e4m3fn.safetensors放置到目录ComfyUI/models/clip 下。下载地址:https://huggingface.co/comfyanonymous/flux_text_encoders/tree/main

工作流界面

该工作流已发布到LIBLIBAI上可自由下载使用:https://www.liblib.art/modelinfo/4e5daf0cf50542199e5bd3b5174b168e。 

01. 牛魔女

A Korean beautiful idol with horns and beautiful face, in a black outfit in the style of James Jean, against a flat red background, with cinematic lighting, in a minimalistic design, with dark contrast

02. 光影

masterpiece, best quality, 1girl ((pure gradient background, )), long hair, floating hair, blush, looking at viewers, happy, ((front)),(upper body), (studio light), soft light, dark style, night style

03. 旗袍

(look at viewer:2), 1 girl, solo,chinese dress, cheongsam, earrings, Chinese roll, smile, lips, light green background,sfw,8k high definition, 35 mm film photography, photo realistic, insanely detailed, intricate, elegant,  best quality, ultra-detailed, masterpiece, finely detail, highres, 8k wallpaper

04. 动漫

(Animation style:1.3),a female character with long, flowing hair that appears to be made of ethereal, swirling patterns resembling the Northern Lights or Aurora Borealis. The background is dominated by deep blues and purples, creating a mysterious and dramatic atmosphere. The character's face is serene, with pale skin and striking features. She wears a dark-colored outfit with subtle patterns. The overall style of the artwork is reminiscent of fantasy or supernatural genres

05. 摄影构图-全身镜头+正面视角

front view, full body shot),1girl, solo, realistic, chinese girl,(cowboy shot:1.2), real life location,tiny pink shirts, midriff, short skirt, smile, cute,, thin short waist, large pelvis,, (high quality:1.4), (photorealistic:1.6), 8k, uhd, highres, absurdres, professional photo, highly detailed, detailed skin

06. 莲花

A lotus flower, close to the sun, triple exposure, fantastic illustrations

07. 小黄人

a group of six minions in a yellow boat on a river in Paris, France. The boat is floating on the water, with the Eiffel Tower in the background. The minions are all facing the same direction and appear to be happy and excited. They are all wearing blue overalls and have big smiles on their faces. The river is lined with buildings on both sides, and there are pink and purple flowers floating in the water. The sky is blue and the overall mood of the image is cheerful and playful.

08. 大猫

hug cat,1girl,solo,(1 orange Giant cat:1.3),red dress,indoor,the cat stands, the girl is next to the cat, 8k high definition, 35 mm film photography

09. 冰雕-文学讲坛

three statues of Chinese characters standing on a stage with a blue background. The statues are made of ice and are intricately carved with detailed features. The characters are dressed in traditional Chinese clothing, with long robes and hats. They are standing in a line, facing towards the left side of the image. The figure on the left is holding a book in his hands, while the figure in the middle is standing with his hands clasped in front of him. All three figures have a serious expression on their faces and appear to be in a contemplative pose. The background is a gradient of blue and white, with rays of light shining down on the figures

10. 沙滩

Beautiful woman in white summer dress standing at the beach, dress and hair flying in the wind, sun glasses, summer day, sunny, detailed sand textures, piercing eyes, perfect delicate face, perfect lips, Oil Painting, expressive brushwork, luminous color palette, and delicate details, Miki Asai Macro photography, close-up, hyper detailed, trending on artstation, sharp focus, studio photo, intricate details, highly detailed, by greg rutkowski


更多推荐文章:

? 可图Kolors生态繁荣里程碑:专属ControlNet与Inpainting模型新成员,可控性灵魂组件

? Florence2:使用LLM助力你的AI绘图,仅需一个模型搞定提示反推&对象检查&蒙版识别&文字识别&咨询建议多功能一体

? Vidu全球上线:AI视频元年已到来,未来可期,可灵&Vidu&清影王者之争

? 腾讯混元DiT1.2:惊艳视觉美感国产中文大模型,ComfyUI最新已支持与操作指南

? [ComfyUI]PhotoMakerV2来袭:腾讯开源无需LoRA训练秒级实现增强人物风格化写真

? ControlNetPlusProMax来袭:SDXL可控性灵魂CN组件再升级,多合一组件再添新功能

? SimpleSDXL:强烈推荐,Fooocus+ComfyUI扩展,XL混元SD3一体,打光&中文提示&蒙版抠图

? [ComfyUI]收缩模型UNET:突破SD模型尺寸限制,直出任意长款比例高清分辨率图像

 StableMakeup:浓妆艳抹,粉妆玉琢;SD实现人物妆点花容迁移

 EchoMimic续篇[ComfyUI]:懂王众星歌唱祖国,体验表情口型更生动自然的逼真数字人框架

? EchoMimic:蚂蚁开源逼真数字人框架,表情口型更生动自然,本地部署包获取

 LivePortrait让你的照片动起来,合成逼真眼部和嘴型表情动作视频

 ControlNetPlus续篇:你仅需一个模型搞定XL绘图控制,无需担心磁盘告急,SDWeb特别篇

?  ControlNetPlus:CN大升级,是时候更新你的XL工具箱,一站式图像生成与编辑组件,ComfyUI使用指南

    感兴趣加入[AGI技术交流群]+V

    如果觉得文章不错,就请在看转发三连!