390 likes | 408 Views
SIGGRAPH 2010. Structure-based ASCII Art Xuemiao Xu, Linling Zhang, Tien-Tsin Wong The Chinese University of Hong Kong. Since the 1860s, text art emerged…. Since the 1860s, text art emerged…. From the 1970s, ASCII art has been widely used…. From the 1970s, ASCII art has been widely used….
E N D
SIGGRAPH 2010 Structure-based ASCII Art Xuemiao Xu, Linling Zhang, Tien-Tsin Wong The Chinese University of Hong Kong
Since the 1860s, text art emerged… Since the 1860s, text art emerged…
From the 1970s, ASCII art has been widely used… From the 1970s, ASCII art has been widely used…
ASCII Art Classification • Tone-based • Halftone approaches Regarded as dithering • O’Grady and Rickard [2008] Dithering essentially • Structure-based
ASCII Art Classification • Tone-based • Halftone approaches Regarded as dithering • O’Grady and Rickard [2008] Dithering essentially • Structure-based • Manual Tedious Automatic generation of structure-based ASCII art
Main Challenge • Arbitrary image content
Main Challenge • Arbitrary image content • Extremely limited character shapes • Restrictive placement of characters
Matching Strategies _ _) • Character matching • Misalignment tolerance • Transformation awareness
Matching Strategies _ _) • Character matching • Misalignment tolerance • Transformation awareness • Image deformation • Increase the chance of matching • Avoid over-deformation (_ (_
Matching Strategies • Character matching • Misalignment tolerance • Transformation awareness • Image deformation • increase the chance of matching • Avoid over-deformation Alignment-insensitive shape similarity metric Constrained deformation
Framework Vectorized polylines Current best matched characters Matching error map Input Rasterized image
Framework _ ^ ) Good matching r ; ; Poor matching Current best matched characters Matching error map
Framework (') (_) Current best matched characters Matching error map
Framework (_) Current best matched characters Matching error map Combined cost map Deformation cost map
Framework Current best matched characters Deformed image Combined cost map Optimal ASCII art
Objective Function • Shape dissimilaritybetween ASCII and deformed images • Deformationcost of the vectorized images E = DAISS Ddeform .
Main Contribution • Shape Matching • Alignment-Insensitive Shape Similarity (AISS) Metric • Constrained Deformation • Deformation Metric
AISS OCR • Matching requirements • Misalignment tolerance • Transformation awareness • Scope • Pattern recognition and image analysis, e.g. OCR O 9 6 O
Design of AISS • Misalignment tolerance log-polar diagram Log-polar histogram Log-polar diagram (5x12)
Design of AISS • Transformation awareness New sampling layout h
Metrics Comparison (1) • Transformation-invariant metrics Query Shape Context Our metric Translation and scale invariant
Metrics Comparison (2) • Alignment-sensitive metrics RMSEafter blurring Our metric SSIM Query Over-emphasize overlapping
Main Contribution • Shape Matching • Alignment-Insensitive Shape Similarity (AISS) Metric • Constrained Deformation • Deformation Metric
Constrained Deformation • Local deformation constraint • Accessibility constraint
A B Local Deformation Constraint B’ r’ r A’
Optimization Vectorized image Input Corresponding ASCII art
Comparison Input O’Grady & Rickard Our method Resolution=30X20 Resolution=20X15
User Study Test set 3: Test set 2: Test set 1: Input By Artist Our Method O’Grady & Rickard Input By Artist Our Method O’Grady & Rickard Input By Artist Our Method O’Grady & Rickard
Conclusion • Mimic ASCII artists’ work by an optimization process • Propose a novel alignment-insensitive shape similarity metric • - alsobenefits pattern recognition • Propose a new deformation metric to control over-deformation
A A Limitation • Do not consider the stylish variation of line thickness within a font • Do not handle proportional placement of characters • Affected by the quality of the vectorization