Finegrain/refiners
1
0
Fork 0
mirror of https://github.com/finegrain-ai/refiners.git synced 2024-11-22 22:28:46 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
635 commits 35 branches 5 tags 149 MiB
Commit graph

635 commits

This branch
This branch
All branches
Author SHA1 Message Date
Cédric Deltheil 60981b79a6 add github workflow for mkdocs 2024-01-08 17:54:54 +01:00
Cédric Deltheil 9b9578cb7e add new rye script for mkdocs serving 
i.e. useful for preview:

    rye run serve-docs
 2024-01-08 17:54:54 +01:00
Cédric Deltheil b640495dd0 mkdocs init 
Via:

    rye run mkdocs new .
 2024-01-08 17:54:54 +01:00
Cédric Deltheil f3f9ab8c3c add mkdocs-material as dev dependency 
Via:

    rye add --dev mkdocs-material
 2024-01-08 17:54:54 +01:00
limiteinductive c9e973ba41 refactor CrossAttentionAdapter to work with context. 2024-01-08 15:20:23 +01:00
Pierre Chapuis a08e04c5af fix CI on push 
for reference, documentation is here:
ttps://docs.github.com/en/actions/learn-github-actions/contexts#github-context
 2024-01-08 10:17:21 +01:00
hugojarkoff 00f494efe2 SegmentAnything: add dense mask prompt support 2024-01-05 18:53:25 +01:00
limiteinductive 20c229903f upgrade pyright to 1.1.342 ; improve no_grad typing 2023-12-29 15:09:02 +01:00
limiteinductive 7b14b4d981 add basics notebook 2023-12-23 15:41:58 +01:00
Cédric Deltheil b40a3d2fa7 refresh requirements.lock 
Follow up of 0f56043
 2023-12-21 09:51:26 +01:00
limiteinductive 12eef9cca5 remove default hf_repo from config 2023-12-20 16:58:12 +01:00
limiteinductive 6a1fac876b remove huggingface datasets from default config 2023-12-20 16:58:12 +01:00
limiteinductive 0f560437bc add tomli to training dependancy 2023-12-20 11:11:44 +01:00
Cédric Deltheil 22ce3fd033 sam: wrap high-level methods with no_grad 2023-12-19 21:45:23 +01:00
Cédric Deltheil e7892254eb dinov2: add some coverage for registers 
Those are not supported yet in HF: so just compared with a precomputed
norm. Note: in the initial PR [1] the Refiners' implementation has been
tested against the official code using Torch Hub.

[1]:
https://github.com/finegrain-ai/refiners/pull/132#issuecomment-1852021656
 2023-12-18 10:29:28 +01:00
Cédric Deltheil f0ea1a2509 prepare_test_weights: add DINOv2 2023-12-18 10:29:28 +01:00
Cédric Deltheil 68cc346905 add minimal unit tests for DINOv2 
To be completed with tests using image preprocessing, e.g. test cosine
similarity on a relevant pair of images
 2023-12-18 10:29:28 +01:00
Cédric Deltheil 832f012fe4 convert_dinov2: tweak command-line args 
i.e. mimic the other conversion scripts
 2023-12-18 10:29:28 +01:00
Bryce 5ca1549c96 refactor: convert bash script to python 
Ran successfully to completion. But on a repeat run `convert_unclip` didn't pass the hash check for some reason.

- fix inpainting model download urls
- shows a progress bar for downloads
- skips downloading existing files
- uses a temporary file to prevent partial downloads
- can do a dry run to check if url is valid `DRY_RUN=1 python scripts/prepare_test_weights.py`
- displays the downloaded file hash
 2023-12-15 09:55:59 +01:00
Pierre Chapuis 77fb8032c2 tweak CONTRIBUTING.md section on tests 2023-12-14 18:44:10 +01:00
Pierre Chapuis c27fd62fc5 add a way to run CI on external PRs using a label 2023-12-14 17:52:56 +01:00
Cédric Deltheil 3ff7719cb8 README: add DINOv2 2023-12-14 17:50:41 +01:00
Cédric Deltheil e978b3665d convert_dinov2: ignore pyright errors 
And save converted weights into safetensors instead of pickle
 2023-12-14 17:50:41 +01:00
Laureηt 9337d65e0e
feature: add DINOv2 
Co-authored-by: Benjamin Trom <benjamintrom@gmail.com>
 2023-12-14 17:27:32 +01:00
Benjamin Trom e2f2e33add Update tests/fluxion/layers/test_basics.py 
Co-authored-by: Cédric Deltheil <355031+deltheil@users.noreply.github.com>
 2023-12-13 17:03:28 +01:00
limiteinductive 7d9ceae274 change default behavior of end to None 2023-12-13 17:03:28 +01:00
Cédric Deltheil 82a2aa1ec4 deprecate DDPM step which is unused for now 2023-12-13 15:51:42 +01:00
limiteinductive a7551e0392 Change fl.Slicing API 2023-12-13 09:38:13 +01:00
Cédric Deltheil 11b0ff6f8c ddim: remove unused attribute 2023-12-12 17:26:14 +01:00
Cédric Deltheil 315b4ed2e4 test_schedulers: enforce manual seed 2023-12-12 17:26:14 +01:00
limiteinductive 7992258dd2 add before/after init callback to trainer 2023-12-12 10:22:55 +01:00
Pierre Chapuis 42a0fc4aa0 fix circular imports 2023-12-11 15:27:11 +01:00
Cédric Deltheil c8d5faff9b pyproject.toml: add example for combine-as-imports 
b44d612 was misleading (s/avoid/allow/)
 2023-12-11 13:57:57 +01:00
Cédric Deltheil 792a0fc3d9 run lint rules using latest isort settings 2023-12-11 11:58:43 +01:00
Cédric Deltheil b44d6122c4 pyproject.toml: enable isort rule in Ruff 
Use `combine-as-imports = true` [1] to avoid such kinds or imports on a
single line:

    from torch import Tensor, device as Device, dtype as DType

[1]: https://docs.astral.sh/ruff/settings/#isort-combine-as-imports
 2023-12-11 11:58:43 +01:00
Cédric Deltheil 4c07225d68 pyproject.toml: remove tool.isort section 
Ruff is going to be used instead.

Follow up of #141
 2023-12-11 11:58:43 +01:00
Cédric Deltheil 4fc5e427b8 training_utils: fix extra detection 
Requirements could be, e.g.:

    wandb (>=0.15.7,<0.16.0) ; extra == "training"

Or:

    wandb>=0.16.0; extra == 'training'

Follow up of 86c5497
 2023-12-08 19:09:16 +01:00
limiteinductive 86c54977b9 replace poetry by rye for python dependency management 
Co-authored-by: Cédric Deltheil <cedric@deltheil.me>
Co-authored-by: Pierre Chapuis <git@catwell.info>
 2023-12-08 17:40:10 +01:00
limiteinductive 807ef5551c refactor fl.Parameter basic layer 
Co-authored-by: Cédric Deltheil <cedric@deltheil.me>
 2023-12-08 10:20:34 +01:00
Cédric Deltheil 11422a3faf fix typo in finetune-ldm config 2023-12-07 18:19:45 +01:00
Cédric Deltheil 46b4b4b462 training_utils: fix naming issue timestep->step 2023-12-05 10:05:34 +01:00
limiteinductive 0dc3a17fbf remove unnecessary test 2023-12-04 15:27:06 +01:00
limiteinductive 8bbcf2048d add README bullet point 2023-12-04 15:27:06 +01:00
limiteinductive 37a74bd549 format test_scheduler file 2023-12-04 15:27:06 +01:00
limiteinductive 90db6ef59d add e2e test for sd15 with karras noise schedule 2023-12-04 15:27:06 +01:00
limiteinductive 6f110ee2b2 fix test_scheduler_utils 2023-12-04 15:27:06 +01:00
limiteinductive 1075ea4a62 fix ddpm and ddim __init__ 2023-12-04 15:27:06 +01:00
limiteinductive ad8f02e555 add karras sampling to the Scheduler abstract class, default is quadratic 2023-12-04 15:27:06 +01:00
Pierre Chapuis f22f969d65 remove Black preview mode 
also fix multiline logs in training
 2023-12-04 14:15:56 +01:00
Bryce 4176868e79 feature: add sliced-attention for memory efficiency 
This allowed me to produce HD images on M1 32gb and 7000x5000 on Nvidia 4090

I saw no visual difference in images generated.

Some datapoints on slice_size
# 4096 max needed for SD 1.5 512x512
# 9216 max needed for SD 1.5 768x768
# 16384 max needed for SD 1.5 1024x1024
# 32400 max needed for SD 1.5 1920x1080 (HD)
# 129600 max needed for SD 1.5 3840x2160 (4k)
# 234375 max needed for SD 1.5 5000x3000
 2023-12-01 15:30:23 +01:00