Initial release of DGG2 trained adapters, readout heads, decoders, and controls
Browse files- README.md +49 -0
- expA_dg/cg_frozen_dg_ep3_slim_ckpt.pt.gz +3 -0
- expA_dg/cg_lora_dg_seed1337_ep3_slim_ckpt.pt.gz +3 -0
- expA_dg/cg_lora_dg_seed42_ep3_slim_ckpt.pt.gz +3 -0
- expA_nondg/nondg_enc_lora_s1337.pt +3 -0
- expA_nondg/nondg_enc_lora_s42.pt +3 -0
- expA_nondg/nondg_frozen_inst_s1337.pt +3 -0
- expA_nondg/nondg_frozen_inst_s42.pt +3 -0
- expB_dg/cg_expB_lora_dg_seed42_ep3_slim_ckpt.pt.gz +3 -0
- expB_nondg/bare_nondg_enc_lora_s1337.pt +3 -0
- expB_nondg/bare_nondg_frozen_inst_s1337.pt +3 -0
- expB_nondg/bare_nondg_frozen_inst_s42.pt +3 -0
- expB_nondg/best_nondg_enc_lora_s1337.pt +3 -0
- expB_nondg/best_nondg_enc_lora_s42.pt +3 -0
- expB_nondg/best_nondg_frozen_inst_s1337.pt +3 -0
- expB_nondg/best_nondg_frozen_inst_s42.pt +3 -0
- expB_nondg/final_nondg_enc_lora_s1337.pt +3 -0
- expB_nondg/final_nondg_enc_lora_s42.pt +3 -0
- expB_nondg/final_nondg_frozen_inst_s1337.pt +3 -0
- expB_nondg/final_nondg_frozen_inst_s42.pt +3 -0
- expB_nondg/nondg_enc_lora_s1337.pt +3 -0
- expB_nondg/nondg_enc_lora_s42.pt +3 -0
- expB_nondg/nondg_frozen_inst_s1337.pt +3 -0
- expB_nondg/nondg_frozen_inst_s42.pt +3 -0
- parent_distilled/model_ctx_clean_256.pt +3 -0
- parent_distilled/model_iso_clean_256.pt +3 -0
- parent_distilled/teacher_targets_ctx.pt +3 -0
- parent_distilled/teacher_targets_iso.pt +3 -0
- parent_frozen/decoder.pt +3 -0
README.md
ADDED
|
@@ -0,0 +1,49 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: google/diffusiongemma-26B-A4B-it
|
| 4 |
+
tags:
|
| 5 |
+
- diffusiongemma
|
| 6 |
+
- lora
|
| 7 |
+
- code-graphs
|
| 8 |
+
- neural-code-representations
|
| 9 |
+
- code-refactoring
|
| 10 |
+
- latent-diffusion
|
| 11 |
+
model-index:
|
| 12 |
+
- name: dgg2-latent-code-graphs-adapters
|
| 13 |
+
results: []
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# DiffusionGemma 2: Latent Code Graph Adapters & Checkpoints
|
| 17 |
+
|
| 18 |
+
This repository hosts trained LoRA adapters, dual readout heads, symbol input adapters, and baseline model weights for **DiffusionGemma 2: Latent Code Graphs & Embeddings**.
|
| 19 |
+
|
| 20 |
+
- **Author:** bumblebeers (GitHub: `@bumblebeers`)
|
| 21 |
+
- **License:** Apache 2.0
|
| 22 |
+
- **Base Model:** `google/diffusiongemma-26B-A4B-it`
|
| 23 |
+
- **Code Repository:** [https://github.com/bumblebeers/dgg2-latent-code-graphs](https://github.com/bumblebeers/dgg2-latent-code-graphs)
|
| 24 |
+
|
| 25 |
+
## Model Card & Checkpoint Catalog
|
| 26 |
+
|
| 27 |
+
### 1. Experiment A: DiffusionGemma 26B-A4B Latent Code Graph Adapters
|
| 28 |
+
Trained on 16x16 AST call graph adjacency grids with frozen SigLIP vision tower:
|
| 29 |
+
- **`expA_dg/cg_lora_dg_seed42_ep3_slim_ckpt.pt.gz`**: LoRA DiffusionGemma (seed 42, 3 epochs, 4,824 steps). Includes 150M LoRA adapter weights and 7.00M DualReadoutSoftCanvasHead ($2816 \to 1152$).
|
| 30 |
+
- **`expA_dg/cg_lora_dg_seed1337_ep3_slim_ckpt.pt.gz`**: LoRA DiffusionGemma (seed 1337, 3 epochs, 4,824 steps).
|
| 31 |
+
- **`expA_dg/cg_frozen_dg_ep3_slim_ckpt.pt.gz`**: Frozen DiffusionGemma control (3 epochs, 4,824 steps). Trains only the DualReadoutSoftCanvasHead ($2816 \to 1152$) with frozen 26B base.
|
| 32 |
+
|
| 33 |
+
### 2. Experiment B: Continuous Symbol Vector Refactoring Adapters
|
| 34 |
+
Modified model with trained input adapter mapping continuous symbol vectors directly into native soft-token space:
|
| 35 |
+
- **`expB_dg/cg_expB_lora_dg_seed42_ep3_slim_ckpt.pt.gz`**: **Modified model: trained input adapter** + LoRA DiffusionGemma (seed 42, 3 epochs, 4,824 steps). Includes:
|
| 36 |
+
- `SymbolVectorInputAdapter` (`LayerNorm(384) + Linear(384, 2816)` with RMS matching)
|
| 37 |
+
- LoRA adapters on attention and MLP projections
|
| 38 |
+
- `DualReadoutSoftCanvasHead` ($2816 \to 384$)
|
| 39 |
+
|
| 40 |
+
### 3. Frozen Decoders & Distilled Teacher Codebooks
|
| 41 |
+
- **`parent_frozen/decoder.pt`**: Standalone 34.15M parameter ViT+Conv `ImageDecoder` mapping continuous visual latent tokens $h_v \in \mathbb{R}^{256 \times 1152}$ to full-resolution $768 \times 768$ RGB images.
|
| 42 |
+
- **`parent_distilled/model_ctx_clean_256.pt`**: Contextualized spatial teacher model (`ContextualizedSpatialMLP`) distilling 26B multi-prompt token distributions into spatial patch representations ($K_{\text{cand}}=11,964$).
|
| 43 |
+
- **`parent_distilled/model_iso_clean_256.pt`**: Isolated spatial teacher model distilling photometric patch codebooks.
|
| 44 |
+
- **`parent_distilled/teacher_targets_ctx.pt` & `teacher_targets_iso.pt`**: Pre-computed target probability tensors for vocabulary distribution evaluation.
|
| 45 |
+
|
| 46 |
+
### 4. Non-Diffusion Spatial Transformer Baselines
|
| 47 |
+
Matched 26.8M parameter transformer controls trained with AdaLN instruction modulation:
|
| 48 |
+
- **`expA_nondg/`**: Checkpoints for encoder-LoRA and frozen-instruction baselines (seeds 42 and 1337) on Experiment A adjacency grids.
|
| 49 |
+
- **`expB_nondg/`**: Checkpoints for encoder-LoRA and frozen-instruction baselines on Experiment B continuous symbol representations.
|
expA_dg/cg_frozen_dg_ep3_slim_ckpt.pt.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f0dfa1ce22384f955eb1ea173dfda83e90a1ab6afd574935078c999b9894826a
|
| 3 |
+
size 26067621
|
expA_dg/cg_lora_dg_seed1337_ep3_slim_ckpt.pt.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:27b36f338272e25e8a5f46cba43a23abe74640b2682f9ce5ba7c35a2010cfe0d
|
| 3 |
+
size 574114755
|
expA_dg/cg_lora_dg_seed42_ep3_slim_ckpt.pt.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ca670f7a7045414ec64a850dbcd661a56b4069fd63b7b7b4c6705acc902803cf
|
| 3 |
+
size 574098824
|
expA_nondg/nondg_enc_lora_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:abcadcc11296af800250d3a1d33407a9945ecc42e88536f7b3a39f7845bdf7f8
|
| 3 |
+
size 297815816
|
expA_nondg/nondg_enc_lora_s42.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:634d27e599fda53e61673a90aacedac8e30297d9c5e8ba4562dc4e00d3d2fdec
|
| 3 |
+
size 297815386
|
expA_nondg/nondg_frozen_inst_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:285961568babdc01231ef962b1a12cb42085c9c46b91ec15b33fd7ab7b4321a5
|
| 3 |
+
size 206921259
|
expA_nondg/nondg_frozen_inst_s42.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:20b5559fda510d905d7c9d4acef1a01632a012b077d10de74ae4222bdf53ca8e
|
| 3 |
+
size 206920411
|
expB_dg/cg_expB_lora_dg_seed42_ep3_slim_ckpt.pt.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:018247da7d0ee878fbab0f3371f3669e7639f82fdfd02296c3a6805570767b7d
|
| 3 |
+
size 575777402
|
expB_nondg/bare_nondg_enc_lora_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5c59011d143b02f729f00f75418c49a9b33663aed70941aedabbe56f010509ea
|
| 3 |
+
size 199534667
|
expB_nondg/bare_nondg_frozen_inst_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e2d5ccf3bd7db8e9dafecda30b8bfc66b028e92924e9cfaa5919fbc30bde073b
|
| 3 |
+
size 199535003
|
expB_nondg/bare_nondg_frozen_inst_s42.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d569c55d3cf014601214eda51ca5845285b28bf3e0c85ce50cfa7dd127cd6c5
|
| 3 |
+
size 199534779
|
expB_nondg/best_nondg_enc_lora_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:59592b1c63b86903be44dabdd5181a1fbc7c81f9c78e69909fef415d132b98b8
|
| 3 |
+
size 290422267
|
expB_nondg/best_nondg_enc_lora_s42.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7fb1a37f976d79e3a9872de2ee6576dc64a3b91552c1f34c53937724a237e146
|
| 3 |
+
size 199533931
|
expB_nondg/best_nondg_frozen_inst_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f605d712d04c55f1e8008383809082c200b71834868a8357ad34b89ea6272e3a
|
| 3 |
+
size 199535131
|
expB_nondg/best_nondg_frozen_inst_s42.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:35865899bd703890b57c5770413e33b8f94cb38bba581a31902e51f84b97a8d7
|
| 3 |
+
size 199534907
|
expB_nondg/final_nondg_enc_lora_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c891fe423a031968542fe84c76d2179c85d19489f71474c36fe13169f8eca37f
|
| 3 |
+
size 290422482
|
expB_nondg/final_nondg_enc_lora_s42.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bbf82b713cd6a14b80b14e874ddbe6cb8cbc48bb79b6354d8d21c9898ce56220
|
| 3 |
+
size 199538715
|
expB_nondg/final_nondg_frozen_inst_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e101210204f45f1a72cf0c3c66cb14c16fae7618c3da9992d12d50c1df130246
|
| 3 |
+
size 199535307
|
expB_nondg/final_nondg_frozen_inst_s42.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bda50c66a3a5a2036c84ef015d10f0edfaf37d92fcddc6638c289562f9d31ca1
|
| 3 |
+
size 199535019
|
expB_nondg/nondg_enc_lora_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f66bb4409665bd497a34e0dd1fe9a5ae8e38d464ab5dc68315c228f8f362848d
|
| 3 |
+
size 290421128
|
expB_nondg/nondg_enc_lora_s42.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d3ba595042d0c9e9b14e405e0b746397471d6045f4b38c0f0f3fbd710c777877
|
| 3 |
+
size 199533371
|
expB_nondg/nondg_frozen_inst_s1337.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:87de3c039e988c437d7e33fb0837467e447e457235a4b22430283d45fe220b92
|
| 3 |
+
size 199534571
|
expB_nondg/nondg_frozen_inst_s42.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f472780856f94c05f36249af1249efed5d3d61538c7c06b288db453dde9529dc
|
| 3 |
+
size 199534283
|
parent_distilled/model_ctx_clean_256.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e2ea566ed17a1bfaee4b54c59fad7208535c11be0fbc4a54d59f564260c1a0e6
|
| 3 |
+
size 124574907
|
parent_distilled/model_iso_clean_256.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:121a612df35396f5463225e500703fd22bf1500711213614c8770a4ee9d0b751
|
| 3 |
+
size 125239629
|
parent_distilled/teacher_targets_ctx.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6dea7c87d6babf8ea31e5d3f6553f85605d15963865d9523ed0028e42b3dde1e
|
| 3 |
+
size 178598301
|
parent_distilled/teacher_targets_iso.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bd9d06e73f09b68873d5c2548af06e3638173ac0d15718429f40aed7fb154a7b
|
| 3 |
+
size 208089829
|
parent_frozen/decoder.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9c759eed4e3d9ae0853371211f80996bf64b5f6bac3e5066336859d0d7673a96
|
| 3 |
+
size 136631951
|