A privacy-first browser extension that runs a small language model and a user-adaptive probabilistic model locally improves search efficiency in a three-week study of 18 volunteers, demonstrating feasible on-device AI assistance without sending browsing data to external services.

Main Finding

A fully client-side hybrid architecture—combining a lightweight, adaptive probabilistic user model with an in‑browser Small Language Model (SLM)—can deliver effective, personalized search assistance while keeping all behavioral data local. In a 3‑week longitudinal study (N=18), the in‑browser adaptation produced a 24% relative improvement in next‑action prediction accuracy over a generic baseline, shortened average search sessions (6.8 → 5.2 queries, p < 0.05), increased query complexity (3.5 → 4.1 terms, p < 0.05), and produced a 36.4% suggestion acceptance rate and high usability/trust scores (SUS=82.5; perceived utility 6.1/7, trust 5.9/7).

Key Points

• Architecture: Fully client-side Firefox extension with three modules — behavioral observation (local logging), dynamic user modeling (MDP + lightweight MLP policy), and hybrid cognitive inference (probabilistic grounding → in‑browser SLM reasoning).
• Privacy: All data and model state stored locally (IndexedDB); no user browsing data sent to external servers. Users control enable/disable/clear logs.
• Models and runtime: Cold start from pre‑trained archetypal policies (exploratory, lookup); online personalization via a lightweight REINFORCE policy gradient update (learning rate 0.01) executed in a Web Worker. Uses a ~2.7B‑parameter Phi family model running via WebGPU in the browser (~9 tokens/sec latency on modern hardware).
• Empirical results: Persona‑Adapted model achieved 38.7% next‑action prediction accuracy (MRR=0.47) vs. Generic‑Exploratory 31.2% (MRR=0.39) and Generic‑Lookup 26.5% (MRR=0.34). Behavioral gains (shorter sessions, richer queries) and favorable subjective evaluations reported.
• Limitations: Small university sample (N=18), short-term study (3 weeks), comparison limited to in‑house generic baselines (no external state‑of‑the‑art server baselines), hardware requirements for smooth in‑browser SLM execution.

Data & Methods

• Implementation: Firefox browser extension; local event capture (queries, SERP clicks with rank/URL, document dwell times); storage via IndexedDB; computation in Web Workers; SLM inference via WebGPU.
• Modeling:
  • Session modeled as an MDP with discrete states (e.g., ViewingSERP, ReadingDocument) and actions (ClickDocument_i, ReturnToSERP, SubmitNewQuery(type)).
  • Cold start: compact MLP policy trained on clustered sessions from the AOL query log.
  • Online personalization: policy gradient (REINFORCE) updates from binary user feedback on suggestions (+1 accept, −1 discard).
  • SLM grounding: predicted next action a* inserted into a prompt template plus recent history; SLM generates concise contextual suggestions constrained by the probabilistic prediction.
• Study design:
  • Participants: 18 (12 male, 6 female), ages 21–32, recruited from a university.
  • Timeline: Week 1 baseline (extension installed, suggestions disabled); Weeks 2–3 intervention (suggestions enabled); participants used their own laptops and exported anonymized logs at study end.
  • Evaluation: Temporal hold-out within participants (first 80% interactions for simulated adaptation; final 20% for prediction testing); paired t-tests for behavioral comparisons; SUS and subjective ratings collected post-study.
• Key metrics reported: next‑action accuracy and MRR; average query length; average session length; suggestion acceptance rate; SUS/usability and trust/utility ratings.

Implications for AI Economics

• Cost structure and marginal economics
  • Lower ongoing API/hosting costs: On‑device SLM execution avoids per‑query cloud API fees and bandwidth costs, shifting marginal cost of inference from centralized providers to end‑user devices.
  • Capital vs. operating: Firms may trade recurring cloud expenses for one‑time engineering and distribution costs (packaging SLMs, client software maintenance, and model update logistics).
  • Energy and compute tradeoffs: Specialized SLMs for vertical tasks are more compute‑efficient than large general LLMs. However, energy consumption shifts to end devices (possible gains in datacenter energy reduction but increased device energy usage).
• Market structure and competition
  • Product differentiation via privacy: Client‑side privacy-preserving agents can be a market differentiator versus cloud‑based assistants, affecting user choice and competition among browsers, OS vendors, and search providers.
  • Reduced lock‑in: When personalization happens locally, control over behavioral data weakens centralized platforms’ data moats, potentially lowering entry barriers for smaller firms and extensions that deliver on-device intelligence.
  • New markets: Demand for compact, high‑quality on‑device SLMs, tooling for local fine‑tuning/updates, and verification/packaging services could create new supplier niches.
• Advertising, data markets, and platform revenues
  • Advertising effectiveness: If personalization shifts from server‑side user profiling to local inference without data sharing, centralized ad platforms could lose signal and targeting precision, pressuring ad revenues and changing ad pricing.
  • Alternative monetization: Firms may need to explore subscription, bundled services, or privacy‑preserving ad models (e.g., on‑device cohorting) to replace lost data monetization.
• Incentives, governance, and regulation
  • Compliance and regulatory costs: Client-side processing reduces compliance burdens and legal risks associated with transmitting sensitive data across borders, potentially lowering firms’ regulatory costs.
  • User bargaining power: Local personalization that preserves user agency (explicit accept/decline) strengthens consumer control and could influence regulatory standards and expectations.
• Distributional and access considerations
  • Digital divide: Effective in‑browser agents require capable devices (WebGPU support, memory/GPU), which risks excluding users with older/cheaper hardware—raising equity concerns and creating a two‑tiered set of AI services.
  • Upfront costs vs. scale: Large platforms can amortize model development and frequent update costs across millions of users; smaller developers may face higher per‑user costs for model packaging and maintenance unless offloaded to third‑party model marketplaces.
• Strategic implications for firms
  • Browser and OS vendors: Opportunity to integrate or curate on‑device SLMs and private assistants, increasing platform stickiness without harvesting data.
  • Search engines: May need to adapt business models if users shift to local agents that reduce observable behavior; could respond by offering hybrid options (privacy‑preserving APIs, on-device ranking models).
  • Developers and startups: Can differentiate on privacy, low latency, and domain specialization by deploying optimized SLMs. However, they must manage model updates, trust, and user experience constraints.
• Research and policy directions (economics-focused)
  • Quantify macro impacts: Model the aggregate effect on ad markets and platform revenues if large shares of personalization move on‑device.
  • Welfare analysis: Compare consumer surplus gains from privacy and improved search efficiency versus potential losses from reduced ad‑subsidized free services.
  • Distributional studies: Assess which user segments benefit or are excluded by on‑device approaches and policy remedies to mitigate inequality (e.g., subsidized hardware, edge compute credits).
  • Incentive mechanisms for model updates: Explore marketplaces or public goods models for distributing SLM updates while preserving privacy and decentralization.

Suggested next empirical steps for economists: - Run field experiments comparing ad click-through, revenue, and engagement between users with local agents vs. cloud assistants. - Estimate firm‑level cost savings and revenue shifts from adopting on‑device SLMs. - Model welfare and distributional consequences of a large‑scale shift to client‑side personalization.

Overall, this paper provides a credible technical demonstration that privacy‑preserving, on‑device AI assistants are feasible and effective for a concrete vertical (search). For AI economics, that possibility entails shifts in cost structures, market power, monetization strategies, and distributional outcomes that merit systematic study.