bumblebeer commited on
Commit
e1d44c0
·
verified ·
1 Parent(s): 6222562

Initial release of DGG2 trained adapters, readout heads, decoders, and controls

Browse files
README.md ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/diffusiongemma-26B-A4B-it
4
+ tags:
5
+ - diffusiongemma
6
+ - lora
7
+ - code-graphs
8
+ - neural-code-representations
9
+ - code-refactoring
10
+ - latent-diffusion
11
+ model-index:
12
+ - name: dgg2-latent-code-graphs-adapters
13
+ results: []
14
+ ---
15
+
16
+ # DiffusionGemma 2: Latent Code Graph Adapters & Checkpoints
17
+
18
+ This repository hosts trained LoRA adapters, dual readout heads, symbol input adapters, and baseline model weights for **DiffusionGemma 2: Latent Code Graphs & Embeddings**.
19
+
20
+ - **Author:** bumblebeers (GitHub: `@bumblebeers`)
21
+ - **License:** Apache 2.0
22
+ - **Base Model:** `google/diffusiongemma-26B-A4B-it`
23
+ - **Code Repository:** [https://github.com/bumblebeers/dgg2-latent-code-graphs](https://github.com/bumblebeers/dgg2-latent-code-graphs)
24
+
25
+ ## Model Card & Checkpoint Catalog
26
+
27
+ ### 1. Experiment A: DiffusionGemma 26B-A4B Latent Code Graph Adapters
28
+ Trained on 16x16 AST call graph adjacency grids with frozen SigLIP vision tower:
29
+ - **`expA_dg/cg_lora_dg_seed42_ep3_slim_ckpt.pt.gz`**: LoRA DiffusionGemma (seed 42, 3 epochs, 4,824 steps). Includes 150M LoRA adapter weights and 7.00M DualReadoutSoftCanvasHead ($2816 \to 1152$).
30
+ - **`expA_dg/cg_lora_dg_seed1337_ep3_slim_ckpt.pt.gz`**: LoRA DiffusionGemma (seed 1337, 3 epochs, 4,824 steps).
31
+ - **`expA_dg/cg_frozen_dg_ep3_slim_ckpt.pt.gz`**: Frozen DiffusionGemma control (3 epochs, 4,824 steps). Trains only the DualReadoutSoftCanvasHead ($2816 \to 1152$) with frozen 26B base.
32
+
33
+ ### 2. Experiment B: Continuous Symbol Vector Refactoring Adapters
34
+ Modified model with trained input adapter mapping continuous symbol vectors directly into native soft-token space:
35
+ - **`expB_dg/cg_expB_lora_dg_seed42_ep3_slim_ckpt.pt.gz`**: **Modified model: trained input adapter** + LoRA DiffusionGemma (seed 42, 3 epochs, 4,824 steps). Includes:
36
+ - `SymbolVectorInputAdapter` (`LayerNorm(384) + Linear(384, 2816)` with RMS matching)
37
+ - LoRA adapters on attention and MLP projections
38
+ - `DualReadoutSoftCanvasHead` ($2816 \to 384$)
39
+
40
+ ### 3. Frozen Decoders & Distilled Teacher Codebooks
41
+ - **`parent_frozen/decoder.pt`**: Standalone 34.15M parameter ViT+Conv `ImageDecoder` mapping continuous visual latent tokens $h_v \in \mathbb{R}^{256 \times 1152}$ to full-resolution $768 \times 768$ RGB images.
42
+ - **`parent_distilled/model_ctx_clean_256.pt`**: Contextualized spatial teacher model (`ContextualizedSpatialMLP`) distilling 26B multi-prompt token distributions into spatial patch representations ($K_{\text{cand}}=11,964$).
43
+ - **`parent_distilled/model_iso_clean_256.pt`**: Isolated spatial teacher model distilling photometric patch codebooks.
44
+ - **`parent_distilled/teacher_targets_ctx.pt` & `teacher_targets_iso.pt`**: Pre-computed target probability tensors for vocabulary distribution evaluation.
45
+
46
+ ### 4. Non-Diffusion Spatial Transformer Baselines
47
+ Matched 26.8M parameter transformer controls trained with AdaLN instruction modulation:
48
+ - **`expA_nondg/`**: Checkpoints for encoder-LoRA and frozen-instruction baselines (seeds 42 and 1337) on Experiment A adjacency grids.
49
+ - **`expB_nondg/`**: Checkpoints for encoder-LoRA and frozen-instruction baselines on Experiment B continuous symbol representations.
expA_dg/cg_frozen_dg_ep3_slim_ckpt.pt.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0dfa1ce22384f955eb1ea173dfda83e90a1ab6afd574935078c999b9894826a
3
+ size 26067621
expA_dg/cg_lora_dg_seed1337_ep3_slim_ckpt.pt.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27b36f338272e25e8a5f46cba43a23abe74640b2682f9ce5ba7c35a2010cfe0d
3
+ size 574114755
expA_dg/cg_lora_dg_seed42_ep3_slim_ckpt.pt.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca670f7a7045414ec64a850dbcd661a56b4069fd63b7b7b4c6705acc902803cf
3
+ size 574098824
expA_nondg/nondg_enc_lora_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abcadcc11296af800250d3a1d33407a9945ecc42e88536f7b3a39f7845bdf7f8
3
+ size 297815816
expA_nondg/nondg_enc_lora_s42.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:634d27e599fda53e61673a90aacedac8e30297d9c5e8ba4562dc4e00d3d2fdec
3
+ size 297815386
expA_nondg/nondg_frozen_inst_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:285961568babdc01231ef962b1a12cb42085c9c46b91ec15b33fd7ab7b4321a5
3
+ size 206921259
expA_nondg/nondg_frozen_inst_s42.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20b5559fda510d905d7c9d4acef1a01632a012b077d10de74ae4222bdf53ca8e
3
+ size 206920411
expB_dg/cg_expB_lora_dg_seed42_ep3_slim_ckpt.pt.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:018247da7d0ee878fbab0f3371f3669e7639f82fdfd02296c3a6805570767b7d
3
+ size 575777402
expB_nondg/bare_nondg_enc_lora_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c59011d143b02f729f00f75418c49a9b33663aed70941aedabbe56f010509ea
3
+ size 199534667
expB_nondg/bare_nondg_frozen_inst_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2d5ccf3bd7db8e9dafecda30b8bfc66b028e92924e9cfaa5919fbc30bde073b
3
+ size 199535003
expB_nondg/bare_nondg_frozen_inst_s42.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d569c55d3cf014601214eda51ca5845285b28bf3e0c85ce50cfa7dd127cd6c5
3
+ size 199534779
expB_nondg/best_nondg_enc_lora_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59592b1c63b86903be44dabdd5181a1fbc7c81f9c78e69909fef415d132b98b8
3
+ size 290422267
expB_nondg/best_nondg_enc_lora_s42.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fb1a37f976d79e3a9872de2ee6576dc64a3b91552c1f34c53937724a237e146
3
+ size 199533931
expB_nondg/best_nondg_frozen_inst_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f605d712d04c55f1e8008383809082c200b71834868a8357ad34b89ea6272e3a
3
+ size 199535131
expB_nondg/best_nondg_frozen_inst_s42.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35865899bd703890b57c5770413e33b8f94cb38bba581a31902e51f84b97a8d7
3
+ size 199534907
expB_nondg/final_nondg_enc_lora_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c891fe423a031968542fe84c76d2179c85d19489f71474c36fe13169f8eca37f
3
+ size 290422482
expB_nondg/final_nondg_enc_lora_s42.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbf82b713cd6a14b80b14e874ddbe6cb8cbc48bb79b6354d8d21c9898ce56220
3
+ size 199538715
expB_nondg/final_nondg_frozen_inst_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e101210204f45f1a72cf0c3c66cb14c16fae7618c3da9992d12d50c1df130246
3
+ size 199535307
expB_nondg/final_nondg_frozen_inst_s42.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bda50c66a3a5a2036c84ef015d10f0edfaf37d92fcddc6638c289562f9d31ca1
3
+ size 199535019
expB_nondg/nondg_enc_lora_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f66bb4409665bd497a34e0dd1fe9a5ae8e38d464ab5dc68315c228f8f362848d
3
+ size 290421128
expB_nondg/nondg_enc_lora_s42.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3ba595042d0c9e9b14e405e0b746397471d6045f4b38c0f0f3fbd710c777877
3
+ size 199533371
expB_nondg/nondg_frozen_inst_s1337.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87de3c039e988c437d7e33fb0837467e447e457235a4b22430283d45fe220b92
3
+ size 199534571
expB_nondg/nondg_frozen_inst_s42.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f472780856f94c05f36249af1249efed5d3d61538c7c06b288db453dde9529dc
3
+ size 199534283
parent_distilled/model_ctx_clean_256.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2ea566ed17a1bfaee4b54c59fad7208535c11be0fbc4a54d59f564260c1a0e6
3
+ size 124574907
parent_distilled/model_iso_clean_256.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:121a612df35396f5463225e500703fd22bf1500711213614c8770a4ee9d0b751
3
+ size 125239629
parent_distilled/teacher_targets_ctx.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6dea7c87d6babf8ea31e5d3f6553f85605d15963865d9523ed0028e42b3dde1e
3
+ size 178598301
parent_distilled/teacher_targets_iso.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd9d06e73f09b68873d5c2548af06e3638173ac0d15718429f40aed7fb154a7b
3
+ size 208089829
parent_frozen/decoder.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c759eed4e3d9ae0853371211f80996bf64b5f6bac3e5066336859d0d7673a96
3
+ size 136631951