Onediff

- New Features
- Quantize tools for enterprise edition
- https://github.com/siliconflow/onediff/tree/main/src/onediff/quantization
- https://github.com/siliconflow/onediff/blob/main/README_ENTERPRISE.md#onediff-enterprise
- SD-WebUI supports offline quantized model
- OneDiff Quality Evaluation
- https://github.com/siliconflow/OneDiffGenMetrics
- Reuse compiled graph
- https://github.com/siliconflow/onediff/issues/581
- https://github.com/siliconflow/onediff/tree/main/onediff_sd_webui_extensions#fast-model-switching
- reuse graph with constant folding enabled https://github.com/siliconflow/onediff/pull/782
- Refine support for Playground v2.5
- https://github.com/siliconflow/onediff/issues/703
- support ComfyUI-AnimateDiff-Evolved
- https://github.com/siliconflow/onediff/pull/575
- https://github.com/siliconflow/onediff/tree/main/onediff_comfy_nodes/modules/oneflow/hijack_animatediff
- support ComfyUI_IPAdapter_plus
- https://github.com/siliconflow/onediff/tree/main/onediff_comfy_nodes/modules/oneflow/hijack_ipadapter_plus
- support stable cascade
- https://github.com/siliconflow/onediff/pull/659
- Improvements
- Improve performance of VAE
- https://github.com/siliconflow/onediff/issues/667
- Bug fixes
- Fix graph save/load
- Fix cuda memory usage on cuda 0 when run on other device
- Fix the quality problem
- many others bugs/issues from the community are fixed: https://github.com/siliconflow/onediff/milestone/2?closed=1
- Documentation
- Add more intro about onediff: https://github.com/siliconflow/onediff?tab=readme-ov-file#about-onediff

What's Changed
* Add -U in code blocks of installation using aliyun index link by jackalcooper in https://github.com/siliconflow/onediff/pull/699
* Fix black images issues with v2.1 by doombeaker in https://github.com/siliconflow/onediff/pull/701
* enterprise doc add sdwebui by marigoold in https://github.com/siliconflow/onediff/pull/705
* Dev quantize pipeline by hjchen2 in https://github.com/siliconflow/onediff/pull/704
* fix quantize pipeline by hjchen2 in https://github.com/siliconflow/onediff/pull/706
* update script of webui in enterprise doc by marigoold in https://github.com/siliconflow/onediff/pull/709
* add quantize tools for diffusers by hjchen2 in https://github.com/siliconflow/onediff/pull/710
* QuantPipeline support from_single_file by marigoold in https://github.com/siliconflow/onediff/pull/711
* Fix graph save by doombeaker in https://github.com/siliconflow/onediff/pull/702
* support stable cascade by chengzeyi in https://github.com/siliconflow/onediff/pull/659
* Allow image_only_indicator to be None (comfy) by lixiang007666 in https://github.com/siliconflow/onediff/pull/720
* open_conv_bias_add_act_fusion_default by clackhan in https://github.com/siliconflow/onediff/pull/721
* fix ci error by ccssu in https://github.com/siliconflow/onediff/pull/729
* [Fix] black images issues with diffusers SD2.1 by lixiang007666 in https://github.com/siliconflow/onediff/pull/725
* [feat] Add SVD1.1 example by lixiang007666 in https://github.com/siliconflow/onediff/pull/726
* doc for rsd to by strint in https://github.com/siliconflow/onediff/pull/713
* SD-WebUI supports offline quantized model by marigoold in https://github.com/siliconflow/onediff/pull/718
* Refactor onediffx deepcache by clackhan in https://github.com/siliconflow/onediff/pull/733
* fix pipeline save load by strint in https://github.com/siliconflow/onediff/pull/734
* fix_sdxl_light_test_scrip by clackhan in https://github.com/siliconflow/onediff/pull/735
* use diffusers' builtin instant id by chengzeyi in https://github.com/siliconflow/onediff/pull/738
* fix upcast_vae by hjchen2 in https://github.com/siliconflow/onediff/pull/741
* fix import error by ccssu in https://github.com/siliconflow/onediff/pull/746
* onediffx.lora supports diffusers>=0.19.3 by marigoold in https://github.com/siliconflow/onediff/pull/740
* sd-webui supports reuse compiled graph by marigoold in https://github.com/siliconflow/onediff/pull/742
* import torch first by strint in https://github.com/siliconflow/onediff/pull/751
* support ComfyUI-AnimateDiff-Evolved by ccssu in https://github.com/siliconflow/onediff/pull/575
* Reuse pipe by strint in https://github.com/siliconflow/onediff/pull/647
* fix_multi_resulotion_error by clackhan in https://github.com/siliconflow/onediff/pull/754
* refine_spatio_temporal_oflow by clackhan in https://github.com/siliconflow/onediff/pull/755
* sd-webui override send_model_to_cpu by marigoold in https://github.com/siliconflow/onediff/pull/758
* remove reuse pipe ci test by marigoold in https://github.com/siliconflow/onediff/pull/759
* [add] deep-cache test by ccssu in https://github.com/siliconflow/onediff/pull/739
* refine readme by doombeaker in https://github.com/siliconflow/onediff/pull/768
* fix_cuda0_mem_usage_error by clackhan in https://github.com/siliconflow/onediff/pull/770
* fix bug of WebUI which quantization is always True by marigoold in https://github.com/siliconflow/onediff/pull/775
* Add SD 1.5 quant example for diffusers by lixiang007666 in https://github.com/siliconflow/onediff/pull/757
* Fix: Change ComfyUI-AnimateDiff-Evolved load to warning. by ccssu in https://github.com/siliconflow/onediff/pull/777
* Fix AttributeError in OneFlowDeepCacheSpeedUpModelPatcher by ccssu in https://github.com/siliconflow/onediff/pull/774
* fix ComfyUI_IPAdapter_plus use by ccssu in https://github.com/siliconflow/onediff/pull/732
* Fix Torch-to-OneFlow Transformation Time by ccssu in https://github.com/siliconflow/onediff/pull/786
* reuse graph with constant folding for sd webui by marigoold in https://github.com/siliconflow/onediff/pull/782
* refactor oneflow_compile to support multiple backends by hjchen2 in https://github.com/siliconflow/onediff/pull/787
* Fix redundant warning printing by ccssu in https://github.com/siliconflow/onediff/pull/788
* develop compile options and rm use_graph by hjchen2 in https://github.com/siliconflow/onediff/pull/791
* test_quantize_custom_model by ccssu in https://github.com/siliconflow/onediff/pull/756
* Imporve ENTERPRISE doc by lijunliangTG in https://github.com/siliconflow/onediff/pull/784
* Update quant ci examples by lijunliangTG in https://github.com/siliconflow/onediff/pull/792
* refactor graph reuse by marigoold in https://github.com/siliconflow/onediff/pull/790
* Dev refactor onediff comfy nodes by ccssu in https://github.com/siliconflow/onediff/pull/796
* fix bug in generate_constant_folding_info by marigoold in https://github.com/siliconflow/onediff/pull/811

New Contributors
* lijunliangTG made their first contribution in https://github.com/siliconflow/onediff/pull/784

**Full Changelog**: https://github.com/siliconflow/onediff/compare/0.12.1...1.0.0

SD Webui support img2img



Change log
* Official LoRA compatible with OneDiff by marigoold in https://github.com/siliconflow/onediff/pull/507
* use dict.setdefault in oneflow_compile by marigoold in https://github.com/siliconflow/onediff/pull/515
* fix compilation failure of resnet50 and faster_rcnn by haoyang9804 in https://github.com/siliconflow/onediff/pull/491
* Add SILICON_ONEDIFF_LICENSE_KEY by jackalcooper in https://github.com/siliconflow/onediff/pull/519
* Dev quant tools and fix graph file management by ccssu in https://github.com/siliconflow/onediff/pull/495
* refine document of setup by doombeaker in https://github.com/siliconflow/onediff/pull/522
* replace reshape by flatten and unflatten to speedup svd by hjchen2 in https://github.com/siliconflow/onediff/pull/516
* graph load fix by strint in https://github.com/siliconflow/onediff/pull/525
* compile vae decoder to avoid oneflow module to while upcasting vae by hjchen2 in https://github.com/siliconflow/onediff/pull/526
* Debug Comfy in CI by jackalcooper in https://github.com/siliconflow/onediff/pull/521
* simplify test by strint in https://github.com/siliconflow/onediff/pull/529
* Enable docker hub cache by jackalcooper in https://github.com/siliconflow/onediff/pull/532
* Add links for NA/EU by jackalcooper in https://github.com/siliconflow/onediff/pull/542
* Reorder links by jackalcooper in https://github.com/siliconflow/onediff/pull/544
* support_deepcache_svd_pipeline by clackhan in https://github.com/siliconflow/onediff/pull/514
* view comfyui log by doombeaker in https://github.com/siliconflow/onediff/pull/534
* Documents for OneDiff Enterprise by doombeaker in https://github.com/siliconflow/onediff/pull/545
* fix adpater id argument by doombeaker in https://github.com/siliconflow/onediff/pull/478
* Dev optimize svd by chengzeyi in https://github.com/siliconflow/onediff/pull/533
* fix bug of _torch_module_to_with_check using oneflow args by marigoold in https://github.com/siliconflow/onediff/pull/548
* transform diffusers AttnProcessor by hjchen2 in https://github.com/siliconflow/onediff/pull/550
* update readme by doombeaker in https://github.com/siliconflow/onediff/pull/553
* Update hf sd1.5 model url by doombeaker in https://github.com/siliconflow/onediff/pull/554
* rm dynamo by hjchen2 in https://github.com/siliconflow/onediff/pull/558
* Fix Quantitative Execution in sd_webui by ccssu in https://github.com/siliconflow/onediff/pull/517
* Publish onediff on pypi automatically by jackalcooper in https://github.com/siliconflow/onediff/pull/560
* add sd-webui api doc and script by marigoold in https://github.com/siliconflow/onediff/pull/559
* Fix ControlNet Usage by ccssu in https://github.com/siliconflow/onediff/pull/561
* align dynamic param with torch by strint in https://github.com/siliconflow/onediff/pull/537
* update readme by doombeaker in https://github.com/siliconflow/onediff/pull/562
* Add community version controlnet performance testing by ccssu in https://github.com/siliconflow/onediff/pull/557
* [diffusers] support dynamic batch size by hjchen2 in https://github.com/siliconflow/onediff/pull/552
* Enable dynamic for comfy by strint in https://github.com/siliconflow/onediff/pull/535
* fix ControlLora usage by ccssu in https://github.com/siliconflow/onediff/pull/565
* add ci for deepcache and int8 by doombeaker in https://github.com/siliconflow/onediff/pull/556
* Enable MLIR logging flags in CI by jackalcooper in https://github.com/siliconflow/onediff/pull/568
* speedup node create mixed modelpatcher by marigoold in https://github.com/siliconflow/onediff/pull/472
* Support YGemm by chengzeyi in https://github.com/siliconflow/onediff/pull/563
* Support SVD dynamic shape[feat] by lixiang007666 in https://github.com/siliconflow/onediff/pull/564
* add cached load_lora_weight by marigoold in https://github.com/siliconflow/onediff/pull/524
* support custom svd by strint in https://github.com/siliconflow/onediff/pull/536
* make diffusers_extensions.utils a package by isidentical in https://github.com/siliconflow/onediff/pull/579
* [Fix] dynamic switch for uncommon resolutions by lixiang007666 in https://github.com/siliconflow/onediff/pull/573
* Fix typo in README.md by jackalcooper in https://github.com/siliconflow/onediff/pull/583
* fix_multi_resolutions_bug by clackhan in https://github.com/siliconflow/onediff/pull/578
* add graph cache key by ccssu in https://github.com/siliconflow/onediff/pull/576
* [perf] Remove redundant reshape op by lixiang007666 in https://github.com/siliconflow/onediff/pull/586
* Modify readme ee for svd by lixiang007666 in https://github.com/siliconflow/onediff/pull/588
* implement compile_pipe and oneflow_compiler_config by chengzeyi in https://github.com/siliconflow/onediff/pull/584
* add quant_unet by ccssu in https://github.com/siliconflow/onediff/pull/592
* Fix Check Failed Error by ccssu in https://github.com/siliconflow/onediff/pull/585
* rename_diffusers_extension_to_onediffx by clackhan in https://github.com/siliconflow/onediff/pull/593
* Update onediffx README.md by strint in https://github.com/siliconflow/onediff/pull/596
* fix env var by chengzeyi in https://github.com/siliconflow/onediff/pull/598
* Dev support instant id by chengzeyi in https://github.com/siliconflow/onediff/pull/597
* Update setup.py by lixiang007666 in https://github.com/siliconflow/onediff/pull/606
* Refactor dualmodule._modules by marigoold in https://github.com/siliconflow/onediff/pull/604
* add repr of dualmodule by marigoold in https://github.com/siliconflow/onediff/pull/610
* Update enterprise readme for comfy svd by lixiang007666 in https://github.com/siliconflow/onediff/pull/608
* [feat] SVD dynamic shape for comfyui by lixiang007666 in https://github.com/siliconflow/onediff/pull/600
* Fix svd for comfy by lixiang007666 in https://github.com/siliconflow/onediff/pull/611
* add attention_allow_quantization option by chengzeyi in https://github.com/siliconflow/onediff/pull/612
* Diffusers ext LoRA support text encoder by marigoold in https://github.com/siliconflow/onediff/pull/587
* reduce transpose operations to speedup by hjchen2 in https://github.com/siliconflow/onediff/pull/589
* use EulerAncestralDiscreteScheduler for instant_id and text_to_image by chengzeyi in https://github.com/siliconflow/onediff/pull/623
* Fix duplicate compilation by ccssu in https://github.com/siliconflow/onediff/pull/622
* point DualModule buffers and params to torch_module by marigoold in https://github.com/siliconflow/onediff/pull/617
* fix_readme by clackhan in https://github.com/siliconflow/onediff/pull/625
* Supporting obj is not an object. by ccssu in https://github.com/siliconflow/onediff/pull/621
* fix bug of dual module (setattr, and compatible with DualModule input) by marigoold in https://github.com/siliconflow/onediff/pull/613
* Black config by strint in https://github.com/siliconflow/onediff/pull/627
* Fix typo installing onediff_diffusers_extensions by jackalcooper in https://github.com/siliconflow/onediff/pull/632
* fix compatibility with peft and diffusers 0.26.1 by chengzeyi in https://github.com/siliconflow/onediff/pull/626
* diffusers tests run with vm by strint in https://github.com/siliconflow/onediff/pull/634
* update readme with news by strint in https://github.com/siliconflow/onediff/pull/638
* Fix svd deepcache dynamic shape by lixiang007666 in https://github.com/siliconflow/onediff/pull/635
* support save graph which has dataclass output and add reverse_proxy_class by strint in https://github.com/siliconflow/onediff/pull/633
* Refine SVD test example by lixiang007666 in https://github.com/siliconflow/onediff/pull/639
* remove sdxl turbo custom scheduler to refine quality by doombeaker in https://github.com/siliconflow/onediff/pull/614
* Run turbo in examples by jackalcooper in https://github.com/siliconflow/onediff/pull/637
* Revert "Run turbo in examples" by jackalcooper in https://github.com/siliconflow/onediff/pull/640
* fix no module named 'onediffx.utils' error by chengzeyi in https://github.com/siliconflow/onediff/pull/624
* fix diffusers>=0.26 compatibility for deepcache/onediffx by isidentical in https://github.com/siliconflow/onediff/pull/641
* [Fix] deepcache uncommon resolution base by lixiang007666 in https://github.com/siliconflow/onediff/pull/620
* mv examples to diffusers extension by strint in https://github.com/siliconflow/onediff/pull/643
* Enhance debug of transform error by strint in https://github.com/siliconflow/onediff/pull/645
* Reuse compiled components betwent pipelines by strint in https://github.com/siliconflow/onediff/pull/644
* refine log by strint in https://github.com/siliconflow/onediff/pull/646
* add quant dual gemm config and quant pipeline by hjchen2 in https://github.com/siliconflow/onediff/pull/651
* update readme, recommend install from source if use plugin by marigoold in https://github.com/siliconflow/onediff/pull/652
* CI for LoRA by marigoold in https://github.com/siliconflow/onediff/pull/595
* sd-webui support img2img by marigoold in https://github.com/siliconflow/onediff/pull/655
* fix printout by ccssu in https://github.com/siliconflow/onediff/pull/658
* compatible_with_diffisers_0.26 by clackhan in https://github.com/siliconflow/onediff/pull/662
* Remove ONEFLOW_RUN_GRAPH_BY_VM in comfy docker compose by jackalcooper in https://github.com/siliconflow/onediff/pull/661
* compatible for sdxl lightning by clackhan in https://github.com/siliconflow/onediff/pull/664
* sd-webui support sgm UNet by marigoold in https://github.com/siliconflow/onediff/pull/668
* Update workflow for lightning by jackalcooper in https://github.com/siliconflow/onediff/pull/670
* Update README_ENTERPRISE.md by ccssu in https://github.com/siliconflow/onediff/pull/672
* add_comfyui_save_graph_dir_variable by ccssu in https://github.com/siliconflow/onediff/pull/673
* Fix ee check by strint in https://github.com/siliconflow/onediff/pull/676
* cache_sdxl_linghtning_pipe by clackhan in https://github.com/siliconflow/onediff/pull/677
* fix: proper loading from remote code by isidentical in https://github.com/siliconflow/onediff/pull/679
* Update diffusers version to latested by strint in https://github.com/siliconflow/onediff/pull/681
* update perf data by strint in https://github.com/siliconflow/onediff/pull/686
* Publish onediffx on PyPI regularly by jackalcooper in https://github.com/siliconflow/onediff/pull/687
* Also install onediffx in docker image by jackalcooper in https://github.com/siliconflow/onediff/pull/689
* fix ci error by ccssu in https://github.com/siliconflow/onediff/pull/688
* Use diffusers.EulerDiscreteScheduler as onediff's implementation by jackalcooper in https://github.com/siliconflow/onediff/pull/692
* Update readme by clackhan in https://github.com/siliconflow/onediff/pull/680
* Add OneDiff for InstantID ComfyUI by ccssu in https://github.com/siliconflow/onediff/pull/693
* refactor onediffx.lora by marigoold in https://github.com/siliconflow/onediff/pull/656
* update readme for v0121 by strint in https://github.com/siliconflow/onediff/pull/694
* fix_svd_resolution_error by ccssu in https://github.com/siliconflow/onediff/pull/690

New Contributors
* isidentical made their first contribution in https://github.com/siliconflow/onediff/pull/579

**Full Changelog**: https://github.com/siliconflow/onediff/compare/0.12.0...0.12.1

SOTA performance update for SDXL and SVD
https://github.com/siliconflow/onediff/tree/main?tab=readme-ov-file#state-of-the-art-performance

Fully support dynamic resolution run of SD and SVD
https://github.com/siliconflow/onediff/blob/55627d50157d4a0c4b484ba76b088c90f39179ff/onediff_diffusers_extensions/examples/text_to_image_sdxl.py#L96

Compile/Save/Load pipeline for HF diffusers
https://github.com/siliconflow/onediff/tree/main/onediff_diffusers_extensions#compile-save-and-load-pipeline

Fast LoRA loading and switching for HF diffusers
https://github.com/siliconflow/onediff/tree/main/onediff_diffusers_extensions#fast-lora-loading-and-switching

Accelerate InstantID
https://github.com/siliconflow/onediff/blob/main/benchmarks/instant_id.py
https://github.com/siliconflow/onediff/tree/main/onediff_comfy_nodes#instantid

Accelerate SDXL lightning
https://github.com/siliconflow/onediff/blob/main/onediff_diffusers_extensions/examples/text_to_image_sdxl_light.py

Reuse compiled components between pipelines
https://github.com/siliconflow/onediff/blob/main/onediff_diffusers_extensions/examples/reuse_compiled_pipeline_components.py

- switch image size will not trigger re-compilation(i.e. no time cost);
- faster to save and load a graph;
- smaller static memory needed;
- much easier to switch graphs;

Note
1. After updating onediff to 0.12, oneflow also needs to be updated to the latest with https://github.com/siliconflow/onediff?tab=readme-ov-file#1-install-oneflow
2. If you are using save/load graph. Please use this new version to save the graph again.
3. For SVD(Stable Video Diffusion) onediff users, please use os.environ["VM_REBUILD_DYNAMIC_SHAPE"] = "1" to support DYNAMIC SHAPE with SVD. There has some re-compile cost, when enabling VM_REBUILD_DYNAMIC_SHAPE, so loading graph is needed. We will do more work on this.

OneDiff SDXL inference has been integrated into fal.ai playground
SDXL inference at the speed of thought: https://www.fal.ai/models/onediff-sdxl

And OneDiff ComfyUI nodes are in ComfyUI-Manager Now