A from-scratch Rust inference stack for AMD GPUs that talks straight to the Linux kernel driver. No ROCm, HIP, or HSA runtime. Serves OLMo 2 on MI355X.
-
Updated
Aug 15, 2026 - Rust
#
olmo
Here are 17 public repositories matching this topic...
TMLR 2026 | Mechanistic interpretability: attention-head binding (EB*) as a marker of concept emergence. 7 models, 5 architectures (Pythia 160M–2.8B, OLMo-1B, CRFM GPT-2, SmolLM3-3B, Qwen2.5-1.5B), 41 terms.
nlp accessibility transformers language-models pythia interpretability few-shot-learning training-dynamics attention-heads mechanistic-interpretability qwen tmlr olmo smollm3 tmlr-2026 concept-emergence crfm
-
Updated
Jun 9, 2026 - Python
Cross-Family Convergence of Neural Network Weight Skeletons. Companion to Zenodo paper (10.5281/zenodo.19652706).
transformers neural-networks pythia percolation weibull-distribution training-dynamics scaling-laws llm olmo
-
Updated
Apr 20, 2026 - TeX
OMTR — can LLM memorization be separated from predictability? Preregistered causal probing (activation patching) in Pythia & OLMo on consumer hardware; three honest non-separations, full corrections history
reproducible-research language-models reproducibility pythia memorization interpretability preregistration llm mechanistic-interpretability activation-patching olmo logit-lens
-
Updated
Aug 22, 2026 - Python
PyTorch DDP and multi-GPU LLM training — from a minimal distributed example to NanoGPT speedruns, Muon, H100 profiling, and modded-nanogpt. FBA LAB https://bubblnet.com
training gpu modal pytorch ddp pytorch-tutorial gpt-2 distributed-data-parallel marin nanogpt llm-training h100 qwen deepseek olmo llm-systems muon-optimizer modded-nanogpt
-
Updated
Aug 20, 2026 - Python
Pre-training a ~150M parameter code-specialized language model using OLMo 3 architecture (GQA, SWA, SwiGLU, RoPE) on PHP/JS/Python/C source code.
-
Updated
Mar 7, 2026 - Jupyter Notebook
First open-source descriptor-augmented LLM for Neglected Tropical Disease drug discovery | OLMo-7B + QLoRA + DeepChem | Bioactivity & Toxicity prediction for Leishmaniasis, Chagas, Malaria, TB
open-source bioinformatics cheminformatics drug-discovery rdkit smiles deepchem toxicity-prediction leishmaniasis llm qlora olmo molecular-ai neglected-tropical-diseases
-
Updated
Jun 23, 2026 - Python
OpenEuroLLM snapshot of the Berkeley Function Calling Leaderboard evaluation harness and OLMo evaluation orchestration.
-
Updated
Aug 3, 2026 - Python
RDKit-Guided Topological State Machine (TSM) for constrained SMILES generation with OLMo-7B. Solves BPE-tokenizer mismatch via RDKit-in-the-loop decoding. Achieved 100% validity on allenai/OLMo-7B-hf.
-
Updated
Mar 12, 2026 - Jupyter Notebook
Paired OLMo continual-training experiment on spaced review and delayed FictionalQA retention
-
Updated
Jul 25, 2026 - Python
OpenEuroLLM tau2-bench evaluation harness with OLMo and Qwen serving, user-simulator, and aggregation scripts.
-
Updated
Aug 3, 2026 - Python
AI工具类（Midjourney / Notion / ChatGPT） 订阅教程类（Netflix / Spotify / Adobe） 虚拟卡支付类（Namecheap / OpenAI / Google）
-
Updated
Mar 4, 2026
Research workspace for model diffing between pretrained and post-trained language models.
transcoder llama sae post-training instruction-tuning mechanistic-interpretability qwen deepseek olmo llm-interpretability gemma3 model-diffing tuned-lens cross-patching
-
Updated
Aug 11, 2026 - Python
Run LLM inference directly on AMD GPUs by bypassing ROCm for low-latency serving.
-
Updated
Sep 1, 2026 - Rust
Add this topic to your repo
To associate your repository with the olmo topic, visit your repo's landing page and select "manage topics."