A small team converted open-weight checkpoints into Thomson, a near-frontier foundation model family, using continual learning to match or surpass many proprietary models in legal, tax and research tasks at substantially lower reported compute cost; transparent benchmarking and human evaluation back the claim, but limited disclosure of data and baseline conditions tempers reproducibility.

Main Finding

Thomson demonstrates that “frontier” performance can be achieved by non-hyperscale actors by applying a disciplined Continual Learning (CL) pipeline to existing open-weight foundation models. Using full‑weight mid- and post‑training (not tiny fine‑tuning or distillation), careful data curation, agentic/tool training and bespoke reward design, a small engineering team produced Thomson-1.0 models that approach or match many contemporaneous proprietary frontier models across a broad benchmark suite — at substantially lower GPU and personnel cost than full pretraining.

Key Points

• Continual Learning as a practical SovereignAI route:
  • CL pipeline preserves stability (no catastrophic forgetting) while enabling plasticity (new capabilities); authors report a distinctive “π-shaped” pattern: strong gains in targeted domains plus improvements across many untargeted capabilities.
• Base models and update strategy:
  • Built from open-weight checkpoints (Qwen3.5‑397B and Qwen3.6‑35B), performing full‑weight updates (not parameter‑efficient adapters) and avoiding large-scale distillation.
• Focus domains and strengths:
  • Targeted at high‑stakes professional use (legal, tax, journalism, Deep Research, document/RAG workflows). Strong on instruction following, summarization, multilingualism, citation quality and document processing.
• Costs, team and timeline:
  • Development run with a small team (≈3 dozen engineers/scientists), max ~368 B200 GPUs during experiments; final three‑week training GPU cost estimated < USD 450k; total development cost ~USD 40M (includes research, infrastructure, domain experts) and a three‑month intensive development timeline from first experiments.
• Safety/value work:
  • Value‑realignment modules (Snowdon variants) and adversarial testing reported; permissive-licensing emphasis for training data; bespoke reward structures to encourage faithful tool use and citation to reduce hallucinations.
• Limitations noted:
  • Relative weakness in coding and some abstract reasoning vs top proprietary models; evaluation vs closed APIs may be imperfect because of opaque guardrails in those systems.
• Reproducibility/portability claim:
  • Authors argue the approach generalizes beyond their exact checkpoints and sizes and can be replicated by other institutions with similar resources.

Data & Methods

• Overall approach:
  • Three complementary CL modules producing foundation models via mid‑training and post‑training stages. Emphasis on minimal, high‑impact parameter interventions and preserving previously learned skills.
• Data‑centric practices:
  • Rigorous curation: filtering, rephrasing, de‑duplication, semantic targeting of human subject‑matter collection, and Bayesian optimisation to calibrate post‑training data mixtures.
• Training methods:
  • Full‑weight updates on open checkpoints (no reliance on a stronger teacher), reward design for tool/agentic behavior, localised error correction and end‑to‑end RL for Deep Research tasks.
• Tool and agentic training:
  • Designed to integrate private retrieval and tool stacks; Deep Research harness for high‑budget tasks; training encourages faithful citations and conditioned tool usage.
• Evaluation:
  • Large, mixed suite spanning legal benchmarks (e.g., Stanford LegalBench, Harvey LAB), tax, journalism, summarisation, long context, multilingualism, safety/adversarial tests, and human blind preference tests (~3,000 rated conversations). Benchmarks ran under controlled, identical prompt and inference settings where possible; closed models evaluated as served endpoints (acknowledging unknown intermediate guardrails).
• Key experimental numbers:
  • Thomson-1.0-Small: 35B parameter open-weight release. Thomson‑1.0‑Large: full‑weight updated large model based on Qwen3.5‑397B checkpoint.
  • Reported GPU budget peak: 368 B200 GPUs; final run GPU cost < USD 450k; total development ≈ USD 40M.

Implications for AI Economics

• Lowers technical & economic barriers to building near‑frontier models:
  • Demonstrates that competent teams with modest compute (vs full pretraining budgets) can produce competitive domain‑specialist or even broadly capable models by investing in CL, data quality and tooling.
• Reduces exclusive advantage of hyperscalers:
  • Shifts some value capture from scale-of-pretraining to data, tooling, bespoke reward design, and continual refinement — enabling more institutions to claim SovereignAI (model/data/governance control).
• New cost structure & business models:
  • Organizations can prioritize investment in mid/post‑training pipelines, evaluation suites, and private tool integration rather than massive pretraining runs; this supports differentiated, verticalized AI products (e.g., legal/tax agents) with lower incremental cost.
• Competitive dynamics:
  • Expect increased decentralization and competition in specialized/high-value segments (enterprises, governments, research labs). Proprietary incumbents may retain advantages in raw scale, hardware access, and opaque system‑level safety measures.
• Regulatory & governance implications:
  • Wider access to powerful models raises policy relevance: licensing/data provenance, auditability of continual updates, and institutional responsibility for safety/alignment become central. Dependence on open‑weight checkpoints and accelerator hardware concentrated supply chains remain systemic risks.
• Strategic guidance for institutions:
  • Invest in CL pipelines, data‑centric processes, evaluation and tool sovereignty to achieve high impact at bounded cost.
  • Secure reliable hardware access and plan for ongoing update cycles; treat model sovereignty as a stack (training + data + tools + governance).
• Risks and caveats for markets:
  • Outcome depends on access to permissively licensed base models; closed‑API guardrails and upstream availability of open checkpoints could constrain adoption.
  • Potential for uneven replication: results are encouraging but may be sensitive to team skill, research infrastructure, and the exact base checkpoints used.

Summary judgment: Thomson provides a compelling, empirically supported blueprint that materially changes the economics of achieving frontier or near‑frontier capabilities for a broad class of institutions. The key economic insight is that focused continual improvement, rigorous data design, and tool integration can substitute for orders‑of‑magnitude pretraining scale in many commercially important domains — shifting where value and competitive advantage reside in the AI ecosystem.