Can you provide support for flux1.dev-fp8?

[JohnsonXi]

[ToTheBeginning]

Provided now.

[NeoAnthropocene]

Does this fp8 implementation drop the VRAM usage under 16 Gigs? The consumer grade GPUs have a maximum of 24 gigs, but not everyone got it for sure.

Do you have any plans to support GGUF models?

[JohnsonXi]

Provided now.

This is a much better job compared to sdxl, thanks for your efforts

[ToTheBeginning]

@NeoAnthropocene We have further optimized the codes, now it supports 16GB cards!

[DrakenZA]

File "/usr/local/lib/python3.10/dist-packages/pydantic/_internal/_generate_schema.py", line 558, in _unknown_type_schema
raise PydanticSchemaGenerationError(
pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set arbitrary_types_allowed=True in the model_config to ignore this error or implement __get_pydantic_core_schema__ on your type to fully support it.

If you got this error by calling handler() within __get_pydantic_core_schema__ then you likely need to call handler.generate_schema(<some type>) since we do not call __get_pydantic_core_schema__ on <some type> otherwise to avoid infinite recursion.

For further information visit https://errors.pydantic.dev/2.9/u/schema-for-unknown-type

I get this error when following the instructions on google colab, it gets all the way to loading up the gradio UI, but when pressing generate i get this.

[ToTheBeginning]

File "/usr/local/lib/python3.10/dist-packages/pydantic/_internal/_generate_schema.py", line 558, in _unknown_type_schema raise PydanticSchemaGenerationError( pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set arbitrary_types_allowed=True in the model_config to ignore this error or implement __get_pydantic_core_schema__ on your type to fully support it.

If you got this error by calling handler() within __get_pydantic_core_schema__ then you likely need to call handler.generate_schema(<some type>) since we do not call __get_pydantic_core_schema__ on <some type> otherwise to avoid infinite recursion.

For further information visit https://errors.pydantic.dev/2.9/u/schema-for-unknown-type

I get this error when following the instructions on google colab, it gets all the way to loading up the gradio UI, but when pressing generate i get this.

@DrakenZA Maybe you can refer to this issue #61

[NeoAnthropocene]

@NeoAnthropocene We have further optimized the codes, now it supports 16GB cards!

Thanks for letting me know!

I guess I will wait to test it on ConfyUI once it becomes really optimized. Waiting for the feedback from cubic and ZhoZhoZho 😀