Florence 2 base PromptGen v2.0 EU AI Act Compliance Profile

Florence-2-base-PromptGen v2.0

This upgrade is based on PromptGen 1.5 with some new features to the model:

Features:

• Improved caption quality for <GENERATE_TAGS>, <DETAILED_CAPTION> and <MORE_DETAILED_CAPTION>. <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-11-05_03-15-15.png" /> <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-11-05_03-40-29.png" />
• A new <ANALYZE> instruction, which helps the model to better understands the image composition of the input image. <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-11-05_03-42-58.png" /> <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-11-05_07-42-36.png" />
• Memory efficient compare to other models! This is a really light weight caption model that allows you to use a little more than 1G of VRAM and produce lightening fast and high quality image captions. <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-09-05_12-56-39.png" />
• Designed to handle image captions for Flux model for both T5XXL CLIP and CLIP_L, the Miaoshou Tagger new node called "Flux CLIP Text Encode" which eliminates the need to run two separate tagger tools for caption creation. You can easily populate both CLIPs in a single generation, significantly boosting speed when working with Flux models. <img style="width:100%; hight:100%" src="https://msdn.miaoshouai.com/miaoshou/bo/2024-09-05_14-11-02.png" />

Instruction prompt:

<GENERATE_TAGS> generate prompt as danbooru style tags<br> <CAPTION> a one line caption for the image<br> <DETAILED_CAPTION> a structured caption format which detects the position of the subjects in the image<br> <MORE_DETAILED_CAPTION> a very detailed description for the image<br> <ANALYZE> image composition analysis mode<br> <MIXED_CAPTION> a mixed caption style of more detailed caption and tags, this

Your obligations as a Florence 2 base PromptGen v2.0 deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags