1 cumulative citations
View corpus contextA touchscreen-derived handwriting dataset and modest extensions to GMM+GMR produce robot motions judged largely human-like: generated trajectories scored 71.5/100 on perceived human-likeness in a 21-person lab study, and the authors publish 3,142 demonstrations as an open benchmark.
Robot Learning from Human Demonstrations: Handwritten Alphabet Trajectories and Human-Likeness Evaluation
The authors release an open dataset of 3,142 touchscreen teleoperation handwriting demonstrations (position, force, timing), extend GMM+GMR to include force and normalized time and to handle multi-segment strokes, and report that generated robot trajectories were rated as human-like (mean = 71.5/100) by 21 participants.
Citation observations
Cumulative provider counts captured on specific dates; providers are never combined.
Learning from demonstration (LfD) provides a developmental framework through which robots can develop motor skills by observing and imitating human dynamics, reducing reliance on explicit programming to teach a skill to a robot. The resulting human-like robot motion is recognised as a key factor in building trust and enabling natural collaboration in human-robot interaction. This paper presents a framework for learning human-like robot motion from demonstration, including data collection, probabilistic trajectory learning, and perceptual user evaluation. A dataset of 3,142 handwriting demonstrations was collected from 22 participants across all 52 Latin alphabet character-case combinations via a touchscreen teleoperation interface, capturing planar position, contact force, and timing. Building on the widely used Gaussian Mixture Model and Gaussian Mixture Regression approach for learning from demonstration, the framework is extended in this work by incorporating force and normalised time dimensions to enable richer representation of human dynamics, and adapting it to handle non-continuous, multi-segment trajectories, enabling generalisation across demonstrations. A user study with 21 participants evaluated the perceived human-likeness of the generated trajectories using a continuous scale anchored between robotic and human-like motion, normalised to 0-100 where 50 represents the neutral midpoint. The generated trajectories achieved an overall human-likeness score of 71.50 (SD=22.56), indicating that the majority of trajectories were perceived as more human-like. Participants identified geometric positioning and trajectory sequence as the most influential perceptual factors, and reported positive attitudes toward human-like robot behaviour. The datasets are released as open-source, providing a reproducible benchmark for developing and evaluating human-like robot motion methods.
Summary
Main Finding
The authors present an end-to-end framework for teaching robots human-like motion from demonstrations, demonstrated on the full 52-character Latin handwritten alphabet (upper+lowercase). They collected a multimodal open dataset (position, contact force, timing) of 3,142 usable demonstrations from 22 people, extended a probabilistic LfD pipeline (GMM+GMR) to jointly learn position, force and normalized time, and added stroke-segmentation to handle discontinuous (pen-lift) trajectories. In a perceptual study (21 participants) the generated robot trajectories were judged substantially human-like (mean human-likeness = 71.50 on a 0–100 scale where 50 = neutral, SD = 22.56). The dataset and code are released as open-source.
Key Points
- Contributions
- A new open-source handwriting demonstration dataset capturing x-y position, contact force, and timestamps for all 52 Latin alphabet characters (3,142 usable trials).
- Two technical extensions to the GMM+GMR LfD pipeline: (i) augmentation of the learned state with contact force and normalized time; (ii) stroke-wise segmentation to handle discontinuities (pen lifts) and train segments independently.
- A human-centred perceptual evaluation showing learned trajectories are generally perceived as human-like, and reporting which perceptual factors (position/geometry and stroke sequence) most influenced judgments.
- Collection & quality control
- 22 participants, each attempted 3 repeats per character; 8.24% of initial trials excluded after manual inspection (missed letters, wrong stroke order, etc.).
- Contact-force thresholding: samples < 0.1 N treated as no-contact and rejected.
- Algorithmic details (high level)
- State vector p(t) = [x(t), y(t), f(t), tnorm(t)]ᵀ; training samples are 5-D vectors [t, x, y, f, tnorm]ᵀ.
- GMM (K = 20 components, EM) models joint distribution over [t,p]; GMR conditions on t to yield smooth joint outputs for x,y,f,tnorm.
- Stroke segmentation performed before training so multi-segment characters are modelled as sets of continuous strokes.
- Perceptual evaluation
- 21 independent participants viewed simulated UR10 robot renderings reproducing the learned trajectories (marker thickness/transparency encoded force).
- Human-likeness rated on continuous scale anchored by original font (0) and human writing (100); overall mean = 71.50 (SD = 22.56).
- Participants reported position/geometry and trajectory sequence as most influential cues; attitudes toward human-like robot motion were positive.
- Reproducibility
- Code and datasets made publicly available: https://github.com/kenanalperen/Trajectory-and-Force-Data-for-Handwritten-Alphabet-Generation.git
- Experimental setup notes
- Teleoperation via touchscreen mapped to a simulated UR10 in Unity; force measured with load cells sampled at 80 Hz; recordings resampled and time-normalized per segment.
Data & Methods
- Dataset
- 3,142 curated handwriting demonstrations (average ≈ 60.4 per character) covering all 52 upper/lowercase Latin characters.
- Modalities: planar position (x,y, mm), contact force (N), absolute timestamps (rescaled to normalized time per demo).
- Acquisition: touchscreen teleoperation interface on HP Spectre x360 with stylus; two HX711 ADC load cells under the touchscreen (80 Hz); ROS-based logging.
- Manual quality control removed ~8.2% of raw trials (3,424 raw → 3,142 kept).
- Learning method
- GMM+GMR probabilistic approach:
- Fit GMM over joint [time, state] using EM with K = 20 (empirically chosen).
- Use GMR to regress the full state vector [x,y,f,tnorm] conditioned on query time t, producing trajectory consensus across demonstrations.
- Augmented state and normalization:
- Force and normalized time included to capture dynamics (velocity/tempo) and contact behaviour.
- Stroke segmentation:
- Demonstrations split into continuous stroke segments (pen-down intervals); each segment trained independently to avoid degradation at discontinuities.
- GMM+GMR probabilistic approach:
- Evaluation
- Perceptual user study: 21 participants rated human-likeness of generated trajectories on a continuous 0–100 scale (50 neutral).
- Post-task questionnaire asked which cues (position, speed, sequence, force) influenced judgments and solicited trust/acceptance perceptions.
- Ethics
- Institutional approval obtained; informed consent and withdrawal procedures implemented.
Implications for AI Economics
- Public good & benchmark value
- The dataset + code create an open benchmark for human-like trajectory learning that lowers entry costs for researchers and firms (reduces data-collection expenditures), enabling comparative progress and faster iteration in HRI research and product development.
- Reducing programming and transaction costs
- LfD approaches like the one demonstrated can lower the cost of deploying new robotic behaviours by enabling non-expert users to “teach” robots via demonstrations rather than bespoke coding. Economically, this reduces the fixed cost component of robot customization and shortens time-to-deployment.
- Adoption, trust, and productivity
- Demonstrably human-like motion (perceptual score ~71.5) is linked in HRI literature to greater predictability and trust. From an economic perspective, improved trust and predictability can lower coordination and monitoring costs in human-robot teams, potentially raising productivity and widening adoption in service and collaborative settings.
- Market structure and firm incentives
- Small and medium enterprises (SMEs) could benefit disproportionately because open datasets and simple probabilistic methods (GMM+GMR) require modest compute/data compared with large deep-learning approaches, lowering barriers to entry for robot-enabled services.
- Conversely, firms investing in advanced imitation learning (diffusion/transformer models) may still gain performance advantages on more complex tasks, creating a two-tier market where dataset-enabled LfD suffices for many applications while large-scale models dominate at scale.
- Labor and complementarity effects
- Easier creation of human-like robot behaviours may cause task reallocation (automation of roles requiring predictable motion) but also create demand for higher-level tasks (supervision, system integration, content of demonstrations). Net labor effects will depend on the pace of adoption and task characteristics (routine vs. creative/empathetic).
- Policy, safety, and regulation
- Human-like motion affects perceived agency and could alter liability/trust calculations; regulators and designers should consider standard benchmarks (like this dataset) for assessing motion naturalness and safety implications when certifying collaborative robots.
- Cost-benefit and scaling considerations
- The present approach is data- and compute-light relative to many deep-learning methods, making it economically attractive for initial deployments. However, scaling to richer interactions (3D manipulation, forceful contact in unstructured environments) will require more sensors, larger datasets, and possibly different model classes — all of which increase upfront investment.
- Research & investment opportunities for economists and firms
- Quantify value of shared datasets: estimate how much time/money open benchmarks save developers and how that translates to faster commercialisation.
- Compare total cost of ownership for robotics solutions built with LfD (as here) vs conventional programming or large imitation-learning models.
- Model adoption thresholds: how improved human-likeness (measured perceptually) shifts firms’ willingness to adopt collaborative robots in different industries.
Suggested follow-ups (economic analyses) - A cost–benefit analysis comparing LfD-enabled deployment vs hand-coded programming across representative manufacturing/service tasks. - Valuation of the open dataset as a public good: estimate avoided data-collection costs and welfare gains from faster innovation. - Empirical studies measuring how increases in perceived human-likeness translate into measurable productivity, reduced supervision, or faster uptake in field deployments.
Repository - https://github.com/kenanalperen/Trajectory-and-Force-Data-for-Handwritten-Alphabet-Generation.git
If you’d like, I can (a) produce a short slide-style summary of economic impacts for stakeholders, (b) sketch a rough cost–benefit framework to evaluate deploying LfD in a particular industry, or (c) extract succinct technical pseudocode of the GMM+GMR + segmentation pipeline. Which would be most useful?
Assessment
Paper Typedescriptive
Evidence Strengthn/a — The paper is primarily descriptive: it introduces a dataset, algorithmic extensions to GMM+GMR, and a perceptual user study; it does not make causal claims or attempt causal identification.
Methods Rigormedium — Data collection and preprocessing are clearly described (3,142 cleaned demonstrations from 22 participants), extensions to a standard probabilistic LfD method (GMM+GMR) are technically plausible, and a human perceptual evaluation was conducted. Limitations include a small and non-representative user-evaluation sample (N=21), reliance on simulated robot playback rather than physical robot trials, manual cleaning of demonstrations (potential selection bias), limited statistical analysis reported for perceptual results, and no comparison to alternative modern imitation learning baselines.
SampleHandwriting dataset: 3,142 cleaned demonstrations (initially 3,424, 8.24% removed) collected from 22 participants (14 male, 8 female; ages 22–57; 21 right-handed) via a touchscreen teleoperation interface controlling a simulated UR10; recordings include planar x,y positions (mm), contact force (N) measured by load cells, and timestamps (normalized time), across all 52 Latin alphabet character-case combinations with three repetitions each. Perceptual evaluation: independent sample of 21 participants (14 male, 7 female; ages 21–53) who rated simulated robot reproductions on a 0–100 human-likeness scale.
Themeshuman_ai_collab adoption
GeneralizabilityTeleoperation on a touchscreen and simulated UR10 may not generalise to physical robot dynamics or different control mappings., Participant pool is small and convenience-based (limited demographic diversity, mostly right-handed), limiting representativeness of handwriting styles., Task is restricted to Latin alphabet handwriting with guided templates and stroke order, so findings may not extend to other motor tasks or free-form writing/drawing., Force measurements via load cells under a touchscreen approximate contact force but differ from real tool-surface or robot end-effector contact in real HRI settings., Perceptual evaluation used simulated visualisations (marker thickness/transparency) rather than live interaction, so social and contextual responses in real collaboration are not measured.