Measured notes from the lab
Articles
25 published results
01
Q2
Lab report
Qwen3.8 20 · Compile and Kernel Efficiency
Text prediction loss · 1.2457
02
Q1
Lab report
Qwen3.8 19 · Data Order and Curriculum
Text prediction loss · 1.1134
03
Q1
Lab report
Qwen3.8 17 · Hybrid Convolution Token Mixing
Text prediction loss · 1.2062
04
Q1
Lab report
Qwen3.8 10 · Initialization and Logits
Text prediction loss · 1.2084
05
Q0
Lab report
Qwen3.8 09 · RoPE and Position
Text prediction loss · 1.2489
06
Q0
Lab report
Qwen3.8 08 · Batch and Accumulation
Text prediction loss · 1.1812
07
Q0
Lab report
Qwen3.8 06 · Attention Heads and GQA
Text prediction loss · 1.2351
08
Q0
Lab report
Qwen3.8 05 · Norm and Residuals
Text prediction loss · 1.2151
09
Q0
Lab report
Qwen3.8 04 · MLP and Activations
Text prediction loss · 1.1844
10
Q0
Lab report
Qwen3.8 03 · Attention Windows
Text prediction loss · 1.2677
11
Q0
Lab report
Qwen3.8 02 · Depth Width Tradeoff
Text prediction loss · 1.1894
12
FR
Lab report
Five-Minute RTX 3090 Training Optimization
Text prediction loss · 1.3092
13
Q0
Lab report
Qwen3.8 01 · Learning Rate and Schedule
Text prediction loss · 1.2474
14
Q0
Lab report
Qwen3.8 07 · Optimizer
Text prediction loss · 1.2221
15
Q1
Lab report
Qwen3.8 11 · Weight Tying and Embeddings
Text prediction loss · 1.2451
16
Q1
Lab report
Qwen3.8 12 · QK Normalization and Scaling
Text prediction loss · 1.2482
17
Q1
Lab report
Qwen3.8 13 · Gradient Clipping
Text prediction loss · 1.2152
18
Q1
Lab report
Qwen3.8 14 · Weight Decay and Regularization
Text prediction loss · 1.2472
19
Q1
Lab report
Qwen3.8 15 · Dropout and Stochastic Regularization
Text prediction loss · 1.2395
20
Q1
Lab report
Qwen3.8 16 · Layer Sharing
Text prediction loss · 1.2488
21
Q1
Lab report
Qwen3.8 18 · Auxiliary Prediction Objectives
Text prediction loss · 1.0196
22
OV
Lab report
Optimize val_bpb in 5-min RTX 3090 run
Text prediction loss · 1.3291
23
R3
Lab report
RTX 3090 · 12h+ Fully Local Autoresearch
Generation speed · 100.1789
24
TR
Lab report
Tailnet Realtime Verification
Text prediction loss · 1.1678
25
R3
Lab report
RTX 3090 Yerel Qwen 3.5 Gece Optimizasyonu
Generation speed · 98.0809