Comfyui upscale workflow example
Comfyui upscale workflow example. All LoRA flavours: Lycoris, loha, lokr, locon, etc… are used this way. Hypernetworks are patches applied on the main MODEL so to use them put them in the models/hypernetworks directory and use the Hypernetwork Loader node like this: Today we will use ComfyUI to upscale stable diffusion images to any resolution we want, and even add details along the way using an iterative workflow! This Jun 8, 2023 · A workflow to split upscale into chunks, fine tune and sharpen then slap them all back together. Dec 19, 2023 · The extracted folder will be called ComfyUI_windows_portable. https://huggingface. Here is an example of how the esrgan upscaler can be used for the upscaling step. image_dzWW6AoA_1720422554033_raw. x and SDXL; Asynchronous Queue system; Many optimizations: Only re-executes the parts of the workflow that changes between executions. Load the 4x UltraSharp upscaling model as your Jan 5, 2024 · Click on Update All to update ComfyUI and the nodes. Img2Img works by loading an image like this example image open in new window, converting it to latent space with the VAE and then sampling on it with a denoise lower than 1. For the positive prompts, don't forget to add the “couple” tag so that there is interaction between the prompts. FLUX is a cutting-edge model developed by Black Forest Labs. Upscaling the latent is the easiest and fastest of the methods. To upscale images using AI see the Upscale Image Using Model node. Unlike other Stable Diffusion tools that have basic text fields where you enter values and information for generating an image, a node-based interface is different in the sense that you’d have to create nodes to build a workflow to generate images. Here are the official checkpoints for the one tuned to generate 14 frame videos (opens in a new tab) and the one for 25 frame videos (opens in a new tab). You can find the Flux Schnell diffusion model weights here this file should go in your: ComfyUI/models/unet/ folder. 333. This image has had part of it erased to alpha with gimp, the alpha channel is what we will be using as a mask for the inpainting. Img2Img works by loading an image like this example image, converting it to latent space with the VAE and then sampling on it with a denoise lower than 1. 5 times and apply a second pass with 0. 1 [schnell] VAE model. It offers convenient functionalities such as text-to-image Examples of what is achievable with ComfyUI open in new window. 120. Jul 30, 2023 · These workflow are intended to use SD1. x, SDXL, LoRA, and upscaling makes ComfyUI flexible. Aug 16, 2023 · ComfyUI wildcards in prompt using Text Load Line From File node; ComfyUI load prompts from text file workflow; Allow mixed content on Cordova app’s WebView; ComfyUI migration guide FAQ for a1111 webui users; ComfyUI workflow sample with MultiAreaConditioning, Loras, Openpose and ControlNet; Change output file names in ComfyUI Video Examples Image to Video. Table of contents. upscale_model. The pixel images to be upscaled. Runs the sampling process for an input image, using the model, and outputs a latent The way you set it up in your example workflow is pretty straightforward the basic setup. As a pivotal catalyst within SUPIR, model scaling dramatically enhances . Jan 8, 2024 · 2. Crop latent and upscale -2. 309. loras: | loras. This should update and may ask you the click restart. Please keep posted images SFW. In this workflow we upscale the latent by 1. 5 days ago · What is the main focus of the 'ComfyUI: Flux with LLM, 5x Upscale (Workflow Tutorial)' video?-The main focus of the video is to provide a tutorial on how to use ComfyUI with Flux, a large language model (LLM), to upscale images up to 5x their original resolution using a custom workflow. Join the largest ComfyUI community. Welcome to the unofficial ComfyUI subreddit. This amazing model can be run directly using Python, but to make things easier, I will show you how to download and run LivePortrait using ComfyUI, the ComfyUI . Upscaling ComfyUI workflow. Direct the node to the models/upscale_models folder, allowing it to access the ESRGAN models. Flux Schnell is a distilled 4 step model. Img2Img works by loading an image like this example image (opens in a new tab), converting it to latent space with the VAE and then sampling on it with a denoise lower than 1. If you are looking for upscale models to use you can find some on Aug 29, 2024 · Upscale Model Examples Here is an example of how to use upscale models like ESRGAN. The upscaled images. Merging 2 Images together. For these examples I have renamed the files by adding stable_cascade_ in front of the filename for example: stable_cascade_canny. Mar 19, 2024 · How to use SDXL lightning with SUPIR, comparisons of various upscaling techniques, vRam management considerations, how to preview its tiling, and even how to An All-in-One FluxDev workflow in ComfyUI that combines various techniques for generating images with the FluxDev model, including img-to-img and text-to-img. 5 models and Lora's to generate images at 8k - 16k quickly. json file. Loads the Stable Video Diffusion model; SVDSampler. You can Load these images in ComfyUI open in new window to get the full workflow. This workflow is bulit on top of them and I learned a lot form their work. 16. Feb 24, 2024 · ComfyUI is a node-based interface to use Stable Diffusion which was created by comfyanonymous in 2023. Here is an example of how to use upscale models like ESRGAN. Download the workflow here in JSON format. You can Load these images in ComfyUI to get the full workflow. FLUX. Change the base_path value to the location of your models. base_path: C:\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI\models\ checkpoints: checkpoints. ControlNet Workflow. NNlatent upscale: Latent upscale on the second and third workflow. safetensors open in new window You can then load or drag the following image in ComfyUI to get the workflow: Flux Schnell. Create animations with AnimateDiff. All the images in this repo contain metadata which means they can be loaded into ComfyUI with the Load button (or dragged onto the window) to get the full workflow that was used to create the image. The same concepts we explored so far are valid for SDXL. SVDModelLoader. In the Load Video node, click on choose video to upload and select the video you want. Accessing the Models in ComfyUI: On the ComfyUI interface, drag the UpscaleModelLoader node into your workflow area. Workflow examples can be found on the Examples page Mar 22, 2024 · As you can see, in the interface we have the following: Upscaler: This can be in the latent space or as an upscaling model; Upscale By: Basically, how much we want to enlarge the image; Hires This workflow is a partial adaptation to ComfyUI, therefore the results might be different from those that you can expect on Runtime44 - Mage Preamble Both this workflow, and Mage , aims to generate the highest quality image, whilst remaining faithful to the original image. Config file to set the search paths for models. 310. 0. Created by: C. outputs¶ IMAGE. crop These are examples demonstrating how to do img2img. Inpainting a cat with the v2 inpainting model: Inpainting a woman with the v2 inpainting model: It also works with non inpainting models. Discovery, share and run thousands of ComfyUI Workflows on OpenArt. It is a node Aug 26, 2024 · Hello, fellow AI enthusiasts! 👋 Welcome to our introductory guide on using FLUX within ComfyUI. Achieves high FPS using frame interpolation (w/ RIFE). outputs. Also, I found a very interesting YouTube video by poisenbery about an alternative method of upscaling that involves the usage of ControlNet. comfyUI stands out as an AI drawing software with a versatile node-based and flow-style custom workflow. 04. Aug 29, 2024 · Lora Examples. 5 kB). crop. The red section contains parameters that can be adjusted according to your needs. Still working on the the whole thing but I got the idea down Note that in ComfyUI txt2img and img2img are the same node. height. Users can drag and drop nodes to design advanced AI art pipelines, and also take advantage of libraries of existing workflows. 1 [schnell] UNET model. NO PROMPT NEEDED - It just works!! How to use this workflow Simply drag and drop the image you want to upscale into the BASIC SETTINGS group box, select your favourite SD 1. To start enhancing image quality with ComfyUI you'll first need to add the Ultimate SD Upscale custom node. If the final image can be rather different from Note: I no longer use Ultimate SD Upscale or the Hand Fix portion of the workflow personally. In this example we will be using this image. Oct 22, 2023 · Obtain the ESRGAN or other upscale models of your choice. Understand how low-resolution images can be transformed into high-definition ones using different methods and algorithms. Here's how you can do it; Launch the ComfyUI manager. Apr 24, 2024 · ComfyUI workflows for upscaling. Txt2Img is achieved by passing an empty image to the sampler node with maximum denoise. ComfyUI provides some of the most flexible upscaling options, with literally hundreds of workflows and nodes dedicated to image upscaling. The SDXL base checkpoint can be used like any regular checkpoint in ComfyUI. Search, for "ultimate”, in the search bar to find the Ultimate SD Upscale node. Cropped multi sampling + multi latent composite plus final output -3 Jan 1, 2024 · グラビア系をターゲットとしたワークフローを作ってみました。 SDXL+LCMー>Upscale->FaceDetailerで顔の調整、というフローです。 Explore the concept of Upscale in AI-based image generation with ComfyUI. These are examples demonstrating how to do img2img. Go to the custom nodes installation section. If you are not interested in having an upscaled image completely faithful to the original you can create a draft with the base model in just a bunch of steps, then upscale the latent and apply a second pass with the base and a third pass with the refiner. Then press “Queue Prompt” once and start writing your prompt. In this ComfyUI tutorial we look at my favorite upscaler, the Ultimate SD Upscaler and it doesn't seem to get as much attention as it deserves. Place them into the models/upscale_models directory of ComfyUI. Update Latest Version of ComfyUI. You can load this image in ComfyUI to get the full workflow. Alternatively, set up ComfyUI to use AUTOMATIC1111’s model files . Pinto: About SUPIR (Scaling-UP Image Restoration), a groundbreaking image restoration method that harnesses generative prior and the power of model scaling up. Workflow examples can be found on the ControlNet and T2I-Adapter - ComfyUI workflow Examples Note that in these examples the raw image is passed directly to the ControlNet/T2I adapter. Each ControlNet/T2I adapter needs the image that is passed to it to be in a specific format like depthmaps, canny maps and so on depending on the specific model if you want good results. In a base+refiner workflow though upscaling might not look straightforwad. Since SDXL requires you to use both a base and a refiner model, you’ll have to switch models during the image generation process. I then recommend enabling Extra Options -> Auto Queue in the interface. update of a workflow with flux and florence. Here is an example of how to use upscale models like ESRGAN. As of writing this there are two image to video checkpoints. Creation and initial generation -1. Initial Setup for Upscaling in ComfyUI. You can also use the UpscaleImageBy node so you don't have to enter sizes, or to decrease the number of nodes (but not spaghetti) there's the Ultimate SD Upscale node, but more efficient than what you already did is going to be a challenge. A pixel upscale using a model like ultrasharp is a bit better -and slower- but it'll still be fake detail when examined closely. safetensors open in new window, stable_cascade_inpainting. SDXL Default ComfyUI workflow. 3. If the workflow is not loaded, drag and drop the image you downloaded earlier. ComfyUI NN Latent Upscale. That's practically instant but doesn't do much either. upscale_models ComfyUI Examples Installing ComfyUI Features Nodes/graph/flowchart interface to experiment and create complex Stable Diffusion workflows without needing to code anything. Let's get started! Img2Img Examples. Feb 7, 2024 · Why Use ComfyUI for SDXL. Width. IMAGE. These nodes include common operations such as loading a model, inputting prompts, defining samplers and more. please pay attention to the default values and if you build on top of them, feel free to share your work :) Jun 23, 2024 · Despite significant improvements in image quality, details, understanding of prompts, and text content generation, SD3 still has some shortcomings. This repo (opens in a new tab) contains examples of what is achievable with ComfyUI (opens in a new tab). If any of the mentioned folders does not exist in ComfyUI/models , create the missing folder and put the downloaded file into it. For example, errors may occur when generating hands, and serious distortions can occur when generating full-body characters. Aug 29, 2024 · Then you can load this image in ComfyUI to get the workflow that shows how to use the LCM SDXL lora with the SDXL base model: The important parts are to use a low cfg, use the "lcm" sampler and the "sgm_uniform" or "simple" scheduler. upscale_method. Upscale Image node. If you are Examples of ComfyUI workflows. Here’s a simple workflow in ComfyUI to do this with basic latent upscaling: Non latent Upscaling. You can Load these images in ComfyUI (opens in a new tab) to get the full workflow. Class name: ImageScale Category: image/upscaling Output node: False The ImageScale node is designed for resizing images to specific dimensions, offering a selection of upscale methods and the ability to crop the resized image. You can take many of the images you see in this documentation and drop it inside ComfyUI to load the full node structure. To load a workflow, simply click the Load button on the right sidebar, and select the workflow . jpg (730. Close ComfyUI and restart it. MAURICIO Mar 8, 2024 · In this easy ComfyUI Tutorial, you'll learn step-by-step how to upscale in ComfyUI. These are examples demonstrating how to use Loras. This example is an example of merging 3 different checkpoints using simple block merging where the input, middle and output blocks of the unet can have a This workflow depends on certain checkpoint files to be installed in ComfyUI, here is a list of the necessary files that the workflow expects to be available. safetensors open in new window For these examples I have renamed the files by adding stable_cascade_ in front of the filename for example: stable_cascade_canny. 5 model, and then enter your This is a workflow that quickly Upscale images to 8K resolution; simply drag and drop your image and click to run. Overview of the whole thing. Requires: WAS nodes, Davemane. Always refresh your browser and click refresh in the ComfyUI window after adding models or custom_nodes. example to extra_model_paths. See the following workflow for an example: See this next workflow for how to mix multiple images together: You can find the input image for the above workflows on the unCLIP example page Aug 29, 2024 · Img2Img Examples. x, 2. safetensors, stable_cascade_inpainting. The resized images. Advanced controlnet: on the second and third workflow for more control over controlnet. Place the models you downloaded in the previous step in the folder: ComfyUI_windows_portable\ComfyUI\models\checkpoints; If you downloaded the upscaler, place it in the folder: ComfyUI_windows_portable\ComfyUI\models\upscale_models; Step 3: Download Sytan's SDXL Workflow Workflow by: Cuong Truong. The following images can be loaded in ComfyUI to get the full workflow. Start ComfyUI. Contribute to greenzorro/comfyui-workflow-upscaler development by creating an account on GitHub. example. You can then load or drag the following image in ComfyUI to get the workflow: Dec 10, 2023 · Introduction to comfyUI. 5. ModelManager. A Apr 16, 2024 · It makes your workflow more compact. Wether or not to center-crop the image to maintain the aspect ratio of the original latent images. Example. Models: Checkpoint: Jul 25, 2024 · Upscale Models (ESRGAN, ESRGAN variants, SwinIR, Swin2SR, etc) unCLIP Models; GLIGEN; Model Merging; LCM models and Loras; SDXL Turbo; AuraFlow; Latent previews with TAESD; Starts up very fast. Stable Zero123 is a diffusion model that given an image with an object and a simple background can generate images of that object from different angles. You might need to change the nodes in the workflows. In this example, we’ll be using a workflow called Creative Upscale created by Eddie from the ComfyUI community. safetensors. The model used for upscaling. That means that the second pass after the upscale has to be done at a very high denoise (0. ComfyUI Examples; 2 Pass Txt2Img (Hires fix) Examples new window to get the workflow. 2. vae: vae. Jul 18, 2024 · Examples from LivePortrait’s repository. 55+). To review any workflow you can simply drop the JSON file onto your ComfyUI work area, also remember that any image generated with ComfyUI has the whole workflow embedded into itself. The only important thing is that for optimal performance the resolution should be set to 1024x1024 or other resolutions with the same amount of pixels but a different aspect ratio. Jan 5, 2024 · Click on Update All to update ComfyUI and the nodes. Fully supports SD1. Please share your tips, tricks, and workflows for using this software to create your AI art. This will be the last update on this particular workflow with having USDU and the Hand Fix. Download Lora Examples. Works fully offline: will never download anything. What is ComfyUI? ComfyUI serves as a node-based graphical user interface for Stable Diffusion. You get to know different ComfyUI Upscaler, get exclusive access to my Co Image to Video. This workflow can use LoRAs, ControlNets, enabling negative prompting with Ksampler, dynamic thresholding, inpainting, and more. Some workflows alternatively require you to git clone the repository to your ComfyUI/custom_nodes folder, and restart ComfyUI. In the most simple form, a ComfyUI upscale workflow would just use an Load Upscale Model node, and might look something like; Load the . But let me know if you need help replicating some of the concepts in my process. 0 reviews. Aug 16, 2024 · Rename extra_model_paths. 🚀 Created by: Mad4BBQ: What this workflow does Extremely EASY to use upscaler/detailer that uses lighting fast LCM and produces highly detailed results that remain faithful to the original image. An advanced implementation of the Perturbed Attention Guidance (PAG) node in ComfyUI. Perturbed Attention Guidance. This guide provides a comprehensive walkthrough of the Upscale pixel and Upscale latent methods, making it a valuable resource for those looking to enhance their image generation projects. If you are looking for upscale models to use you can find some on Jan 8, 2024 · This involves creating a workflow in ComfyUI, where you link the image to the model and load a model. Support for SD 1. I then recommend For these examples I have renamed the files by adding stable_cascade_ in front of the filename for example: stable_cascade_canny. Latent upscaling My actual workflow file is a little messed up at the moment, I don't like sharing workflow files that people can't understand; my process is a bit particular to my needs and the whole power of ComfyUI is for you to create something that fits your needs. json workflow file from the C:\Downloads\ComfyUI\workflows folder. . A neural network latent upscale for much higher quality compared with an interpolated latent upscale. Users have the ability to assemble a workflow for image generation by linking various blocks, referred to as nodes. Here is an example: You can load this image in ComfyUI to get the workflow. Dec 19, 2023 · Here's a list of example workflows in the official ComfyUI repo. The workflow has an upscaler and I set the default to 1024x1024. Upscale Image (using Model) node. 7 denoise. 0. I left USDU and the Hand Fix in this workflow if you prefer using those still. The SDXL base checkpoint can be used like any regular checkpoint in ComfyUI (opens in a new tab). This option is offered as it's very inexpensive computationally and it can be useful if you don't need the final image to be 100% of the initial generation. example usage text with workflow image Created by: OpenArt: The latent can be upscaled directly but the loss in quality is important. Mixing ControlNets Upscale Model Examples; Here is a workflow for using it: Example. Fastest would be a simple pixel upscale with lanczos. Since ESRGAN Jan 22, 2024 · 画像のアップスケールを行うアップスケーラーには ・計算補完型アップスケーラー(従来型。Lanczosなど) ・AIアップスケーラー(ニューラルネット使用。ESRGAN) の2種類があり、ComfyUIでは、どちらも使用することができます。 AIアップスケーラーを使用するワークフロー ComfyUIのExampleにESRGANを Aug 29, 2024 · Inpaint Examples. Standard latent upscaler can be used in its place with poorer results. configs: configs. x, SD2. Here is an example for how to use the Canny Controlnet: Here is an example for how to use the Inpaint Controlnet, the example input image can be found here. inputs. Upscale Image Documentation. It's not practical to use in your workflow for every generation. Heres a Txt file of the workflow. It is a node In ComfyUI the saved checkpoints contain the full workflow used to generate them so they can be loaded in the UI just like images to get the full workflow that was used to create them. Put them in the models/upscale_models folder then use the UpscaleModelLoader node to load them and the ImageUpscaleWithModel node to use them. image. upscale_models This is the input image that will be used in this example: Here is an example using a first pass with AnythingV3 with the controlnet and a second pass without the controlnet with AOM3A3 (abyss orange mix 3) and using their VAE. Here are the official checkpoints for the one tuned to generate 14 frame videos open in new window and the one for 25 frame videos open in new window. If you are looking for upscale models to use you can find some on Think Diffusion's Stable Diffusion ComfyUI Top 10 Cool Workflows. ComfyUI provides a powerful yet intuitive way to harness Stable Diffusion through a flowchart interface. The Upscale Image node can be used to resize pixel images. Once loaded go into the ComfyUI Manager and click Install Missing Custom Nodes. Jul 6, 2024 · To use this upscaler workflow, you must download an upscaler model from the Upscaler Wiki, and put it in the folder models > upscale_models. In the CR Upscale Image node, select the upscale_model and set the Aug 29, 2024 · 3D Examples - ComfyUI Workflow Stable Zero123. ComfyUI (opens in a new tab) Examples. The method used for resizing. The target width in pixels. Upscaling with ComfyUI. Aug 29, 2024 · SDXL Examples. ControlNet Depth ComfyUI workflow. The denoise controls the amount of noise added to the image. Upscale Models (ESRGAN, ESRGAN variants, SwinIR, Swin2SR, etc) unCLIP Models; GLIGEN; Model Merging; LCM models and Loras; SDXL Turbo; AuraFlow; HunyuanDiT; Latent previews with TAESD; Starts up very fast. In the CR Upscale Image node, select the upscale_model and set the Upscale latent. Workflow examples can be found on the In this ComfyUI tutorial we look at my favorite upscaler, the Ultimate SD Upscaler and it doesn't seem to get as much attention as it deserves. 🌟 In this tutorial, we'll dive into the essentials of ComfyUI FLUX, showcasing how this powerful model can enhance your creative process and help you push the boundaries of AI-generated art. Unfortunately the upscaled latent is very noisy so the end image will be quite different from the source. yaml. Share, discover, & run thousands of ComfyUI workflows. All LoRA flavours: Lycoris, loha, lokr, locon, etc are used this way. Created by: homer_26: Workflow based on the ComfyCouple model I made a few changes to make the interface more user-friendly, along with mixing two characters into one image. Leveraging multi-modal techniques and advanced generative prior, SUPIR marks a significant advance in intelligent and realistic image restoration. SDXL Examples. SDXL works with other Stable Diffusion interfaces such as Automatic1111 but the workflow for it isn’t as straightforward. ComfyUI also has a mask editor that can be accessed by right clicking an image in the LoadImage node and “Open in MaskEditor”. I instead use a second KSampler without controlnet to upscale. Save this image then load it or drag it on ComfyUI to get the workflow. 2024, changed the link to non deprecated version of the efficiency nodes. Thanks for ControlAltAI in youtube and Kijai in github. That's exactly what I ended up planning, I'm a newbie to ComfyUI, so I setup Searg's workflow, then copied the official ComfyUI i2v workflow into it and pass into the node whatever image I like. Oct 21, 2023 · This was confirmed when I found the "Two Pass Txt2Img Example" article from official ComfyUI examples. example¶ example usage text with workflow image Here is a workflow for using it: Save this image then load it or drag it on ComfyUI to get the workflow. Aug 29, 2024 · Here is an example of how to use upscale models like ESRGAN. This workflow also has metadata included Aug 29, 2024 · Hypernetwork Examples. Open the YAML file in a code or text editor. Download it and place it in your input folder. Here's how you set up the workflow; Link the image and model in ComfyUI. The target height in pixels. The Upscale Image (using Model) node can be used to upscale pixel images using a model loaded with the Load Upscale Model node. Jul 12, 2024 · There are hundreds of available image upscaling workflows on the internet that essentially do the same thing. In this tutorial we're using a 4x UltraSharp upscaling model known for its ability to significantly improve image quality. All the images in this page contain metadata which means they can be loaded into ComfyUI with the Load button (or dragged onto the window) to get the full workflow that was used to create the image. FLUX text encoders. co Simple workflow for using the new Stable Video Diffusion model in ComfyUI for image to video generation. Img2Img ComfyUI workflow. tbgxg tzb hefj lgc wqxdgh xlst ahqny ovxygkq pavhsg mrf