Finegrain/refiners
1
0
Fork 0
mirror of https://github.com/finegrain-ai/refiners.git synced 2024-11-22 14:18:46 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

cross-attn 2d: record use_bias attribute

Browse source
This commit is contained in:
Cédric Deltheil 2023-08-31 17:52:57 +02:00 committed by Cédric Deltheil
parent b933fabf31
commit 3a10baa9f8
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
src/refiners/foundationals/latent_diffusion/cross_attention.py
View file

@ -137,6 +137,7 @@ class CrossAttentionBlock2d(Sum):
self.num_attention_heads = num_attention_heads self.num_attention_heads = num_attention_heads
self.num_attention_layers = num_attention_layers self.num_attention_layers = num_attention_layers
self.num_groups = num_groups self.num_groups = num_groups
self.use_bias = use_bias
self.context_key = context_key self.context_key = context_key
self.use_linear_projection = use_linear_projection self.use_linear_projection = use_linear_projection
self.projection_type = "Linear" if use_linear_projection else "Conv2d" self.projection_type = "Linear" if use_linear_projection else "Conv2d"