Finegrain/refiners
1
0
Fork 0
mirror of https://github.com/finegrain-ai/refiners.git synced 2024-11-23 06:38:45 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

fix GLU Activation docstrings

Browse source
This commit is contained in:
Laurent 2024-03-29 17:50:05 +00:00 committed by Laureηt
parent f26b6ee00a
commit 04e59bf3d9
1 changed files with 3 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
src/refiners/fluxion/layers/activations.py
View file

@ -140,10 +140,10 @@ class GLU(Activation):
Example:
```py
glu = fl.GLU()
tensor = torch.tensor([[-1.0, 0.0, 1.0]])
glu = fl.GLU(fl.ReLU())
tensor = torch.tensor([[1.0, 0.0, -1.0, 1.0]])
output = glu(tensor)
assert torch.allclose(output, torch.tensor([0.0, 0.0]))
```
"""