Unsupervised pre-annotation cuts pixelwise labeling time for steel microstructure images by about 78%, trimming a 170‑hour task to 37 hours; the paper also releases the largest public high‑resolution steel microstructure segmentation dataset and an industry-validated benchmark model.

Speeding up the annotation process in semantic segmentation industrial applications

Marta Fernandez-Moreno, Margarita Guerrero, Rosalia Rementeria, Pablo Mesejo, Raul Moreno · June 18, 2026

arxiv quasi_experimental medium evidence 7/10 relevance Full text usable extracted full text Source PDF

Using unsupervised computer-vision pre-annotation reduced pixelwise labeling time for high-resolution steel microstructure segmentation from 170 hours to 37 hours (≈78% reduction), and the authors release the largest public annotated dataset plus a benchmark deep-learning model validated in industry.

Current machine learning models commonly require large and well-annotated datasets. However, the annotation process often becomes a bottleneck, with increased complexity leading to higher chances of human errors. Within this context, our goal in this paper is to leverage unsupervised algorithms to improve data annotation efficiency for complex semantic segmentation problems in industrial materials science. Previous research has quantified labeling time and others explored unsupervised methods. However, to the best of our knowledge, this is the first study to quantify how much unsupervised algorithms accelerate the labeling process. We aim to validate the extent to which this laborious process can be accelerated, focusing on semantic segmentation tasks that involve annotating each pixel of high-resolution images, such as the microstructure characterization challenge in materials science. Specifically, we demonstrate that by using unsupervised computer vision algorithms, the time required for the labeling process can be reduced from 170 hours to 37 hours, achieving an approximate reduction of 78\%. The dataset we work with includes large images of dimensions 1280x959 and 960x703, which further increases the complexity of the annotation task. Despite these challenges, we create and share the largest public steel microstructure segmentation dataset to date, available under MIT License with permanent DOI, contributing a fully annotated, high-resolution dataset to the field. Additionally, this is the first work to compare the labeling time from scratch (a common approach in previous studies) to the labeling time when using these unsupervised algorithms as a pre-annotation step. Furthermore, we provide a Deep Learning model trained on this dataset, validated by field experts, and deployed in an industrial setting, serving as an initial benchmark for this public dataset.

Summary

Main Finding

Using unsupervised computer-vision pre-annotations (classic image methods, an unsupervised per-image CNN, and SAM) as an expert refinement starting point reduced the manual labeling effort for a complex, high-resolution steel microstructure semantic‑segmentation task by ≈78% — from 170 hours down to 37 hours. The authors also release MicroSteel, the largest public pixel‑level steel microstructure dataset to date (82 high‑resolution images; MIT license, DOI: 10.5281/zenodo.18826160), and provide a baseline deep‑learning model validated and deployed in an industrial setting.

Key Points

Annotation bottleneck: pixel‑level semantic segmentation of high‑resolution micrographs is extremely time‑consuming and error‑prone; majority classes dominate the pixel budget but minority classes carry domain importance.
Two labeling strategies compared empirically: (A) manual annotation from scratch vs (B) expert refinement of unsupervised pre-annotations. Time per label was logged automatically in Labelbox; medians used to account for inter‑expert variability.
Pre‑annotation techniques evaluated: multi‑Otsu thresholding, graph‑based superpixels, k‑means, an unsupervised CNN trained per image (100–150 epochs), and Segment Anything (SAM). Experts qualitatively chose the best pre‑annotation per image for refinement.
Computational overhead for pre‑annotation is negligible relative to human time: classical methods sub‑second, k‑means 2–5s (CPU); SAM 1–3s and DL per‑image 10–20s (GPU) per image.
Dataset characteristics (MicroSteel): 82 images at 1280×959 and 960×703; five classes — Alpha, TiB2, TiN, FeTiB, Fe2B; split into three processing types (Type I: 29 images, Type II: 17, Type III: 36). Very imbalanced: Alpha ≈74.2% of pixels; TiN ≈0.17%.
Practical outcome: unsupervised methods reliably capture majority classes and complex boundaries sufficiently to serve as effective pre‑annotations that experts can correct quickly, producing final high‑quality labels and enabling fast dataset creation.

Data & Methods

Dataset (MicroSteel)
- Size: 82 fully annotated images (public; GitHub + Zenodo DOI 10.5281/zenodo.18826160).
- Resolutions: 1280×959 and 960×703.
- Classes: index 0 Alpha (74.22%), 1 TiB2 (5.97%), 2 TiN (0.17%), 3 FeTiB (9.22%), 4 Fe2B (10.42%).
- Types: Type I (29 images; Alpha, TiB2, TiN, FeTiB), Type II (17; Alpha, TiB2, TiN), Type III (36; Alpha, TiB2, TiN, Fe2B).
Pre‑annotation methods and runtimes (measured on Intel i9-11900K, 126 GB RAM, NVIDIA RTX 3090)
- Multi‑Otsu: <1 s (CPU)
- Superpixels (graph‑based): <1 s (CPU)
- K‑means: 2–5 s (CPU)
- SAM: 1–3 s (GPU)
- Unsupervised per‑image CNN: 10–20 s (GPU), trained 100–150 epochs per image
Annotation protocol
- Experts refined either a blank canvas (manual) or the chosen pre‑annotation within Labelbox; Labelbox recorded precise annotation time per task.
- Experts selected the best pre‑annotation among methods on a per‑image basis before refinement.
- Comparison metric: total/median annotation time per strategy (manual vs pre‑annotation). Quality of final labels validated by field experts.
Results
- Total annotation time reduced from 170 hours (manual) to 37 hours (pre‑annotation + refinement) for the dataset — ~78% reduction.
- Pre‑annotation computation time (minutes for full dataset) is negligible versus human annotation hours.
- The paper also provides a trained DL model (benchmark) and reports industrial deployment.

Implications for AI Economics

Labor cost and time savings: Reducing expert annotation time by ~78% translates directly to major reductions in labor cost for specialized, high‑value annotators (domain experts). For tasks where expert time is the dominant cost, modest compute (seconds per image) yields large ROI.
Productivity and speed to deploy: Faster dataset creation shortens ML development cycles, accelerating model iteration, deployment, and time‑to‑value for industrial AI applications.
Shifts in human roles: The effective use of pre‑annotations promotes a “human‑in‑the‑loop” model where expert work concentrates on validation and correction of higher‑level/rare classes rather than exhaustive pixel labeling, potentially changing labor demand toward higher‑skill, lower‑volume tasks.
Cost trade-offs: The approach substitutes compute and a small amount of expert curation for large amounts of raw manual labor. Economists and managers can quantify tradeoffs: small incremental compute/engineering costs vs. large reductions in expert labor hours.
Data quality and downstream value: Pre‑annotation plus expert refinement can preserve or improve label quality while lowering cost. For domain‑sensitive applications (materials, healthcare, etc.) this raises the marginal feasibility of collecting larger labeled datasets, which can increase model performance and commercial value.
Market and policy considerations: Lower annotation costs enable more firms (including smaller incumbents and startups) to build specialized datasets and models, potentially increasing competition in industrial AI niches. At the same time, automation of routine annotation could reduce demand for low‑skill annotators; policy and workforce planning should anticipate reskilling needs.
Generalizability caveat: The reported gains derive from a domain where majority classes are large and structural cues are strong; economic estimates should account for domain dependence — tasks with many balanced, fine‑grained minority classes may see smaller gains.
Research and investment implications: Funding and investment in lightweight unsupervised/pre‑annotation tooling (including domain‑adapted SAM‑style models) may be highly cost‑effective; measuring human time saved per dollar of compute should be a key KPI for annotation tech.

Short actionable takeaway: For specialized, expert‑label‑heavy use cases, modest investment in unsupervised pre‑annotation tools yields large reductions in expert hours and cost, accelerating dataset creation and industrial AI deployment — making data acquisition economically more scalable and shifting human labor toward higher‑value correction and validation tasks.

Assessment

Paper Typequasi_experimental Evidence Strengthmedium — The paper provides a direct, quantitative measure of time savings and includes expert validation and industrial deployment, which supports practical relevance; however, the causal claim is based on a simple before/after or comparative measurement without clear randomization, limited reporting of annotator sample size, inter-annotator variability, or potential learning/practice effects, reducing confidence in broad causal generalization. Methods Rigormedium — Methods include producing a large, fully annotated high-resolution dataset, applying unsupervised pre-annotation, timing the labeling process, and training/validating a downstream deep-learning model, but the paper appears to lack important methodological details (randomization, number and expertise of annotators, protocol for timing, statistical tests, and robustness checks) that would raise rigor to high. SampleA newly created, public, fully annotated high-resolution steel microstructure segmentation dataset (images sized 1280x959 and 960x703) released under an MIT license with DOI; annotations produced by human annotators, with experiments comparing manual-from-scratch labeling versus correcting unsupervised algorithm pre-annotations; a deep-learning model trained on this dataset and validated by field experts and deployed in an industrial setting. (Exact number of images and annotators not specified in the description.) Themesproductivity human_ai_collab IdentificationCompare total human annotation time for semantic segmentation performed from scratch versus using unsupervised computer-vision algorithms as a pre-annotation step; measure time spent correcting pre-annotations and compute percent reduction (170h → 37h reported). No randomized assignment or detailed controls reported. GeneralizabilityDomain-specific: steel microstructure images may not represent other computer-vision segmentation tasks (medical, urban scenes, etc.), Image resolution and microstructure characteristics (very high resolution, specific textures) may affect transferability to other datasets, Unclear annotator pool: results may depend on annotator skill, familiarity with domain, and expertise, Details of the specific unsupervised algorithms used matter — other unsupervised methods may produce different gains, Single industrial deployment: industrial workflow, tooling, and validation practices may not generalize to other firms or sectors

Claims (6)

Claim	Direction	Outcome	Confidence & Evidence	Details
Using unsupervised computer vision algorithms, the time required for the labeling process can be reduced from 170 hours to 37 hours, achieving an approximate reduction of 78%. Task Completion Time	positive	labeling time (hours)	Reading fidelity high Study strength medium	from 170 hours to 37 hours (approx. 78% reduction) 0.48
Current machine learning models commonly require large and well-annotated datasets, and the annotation process often becomes a bottleneck with increased complexity leading to higher chances of human errors. Task Completion Time	negative	annotation bottleneck / annotation error likelihood	Reading fidelity high Study strength speculative	not reported 0.08
This is the first study to quantify how much unsupervised algorithms accelerate the labeling process, and the first to compare labeling time from scratch to labeling time when using unsupervised algorithms as a pre-annotation step. Other	positive	novelty of quantitative comparison of labeling times	Reading fidelity high Study strength speculative	not reported 0.08
We create and share the largest public steel microstructure segmentation dataset to date, available under an MIT License with a permanent DOI, contributing a fully annotated, high-resolution dataset to the field. Other	positive	size and availability of dataset (largest public dataset claim)	Reading fidelity high Study strength medium	not reported 0.48
The dataset contains large high-resolution images of dimensions 1280x959 and 960x703, which increase the complexity of the annotation task. Other	null_result	image resolution / annotation complexity	Reading fidelity high Study strength high	not reported 0.8
We provide a Deep Learning model trained on this dataset, validated by field experts, and deployed in an industrial setting, serving as an initial benchmark for this public dataset. Research Productivity	positive	model availability, expert validation, industrial deployment (benchmarking)	Reading fidelity high Study strength medium	not reported 0.48