Hiroaki NISHINO Oita University, Japan

1. A Collaborative 3D Modeler for Networked Virtual Worlds May 25, 2002 Hiroaki NISHINO Oita University, Japan

2. Next Genkai Workshop in Beppu, Oita! The “Big Eye” stadium in Oita city. The Steam from the Kannawa Hot Springs, one of the eight major hot springs in Beppu. Million dollar night view with Mt. Ogi Fire Festival.

3. Collaborative 3D Object Modeling digital archive rapid prototyping museum 3D digitizer 3D geometric data real 3D model 3D solid model generator create real model import and share participate participate artist with wearable computer customer with mobile PC link give me a torus participate engineering designer on a desktop system positioning and blending scaling primitive selection (voice) bending tapering twisting shared collaborative design environment craftsman with immersive virtual environment

4. Collaborative 3D Object Modeling Synchronous visualization update Efficient transmission of latest object data “Sharing of modeling know-how and strategies” intermediate deforming operations rapidly changing geometrical shapes participate participate artist with wearable computer customer with mobile PC link participate engineering designer on a desktop system shared collaborative design environment craftsman with immersive virtual environment

5. Primitive Shape Definition Superquadric toroid Pt Superquadric ellipsoid Pe e2/2 e1 2/e1 2/e2 2/e1 2/e2 Pt(x, y, z) = [[{( )+ ( ) } ] + ( ) ] Deformation ra e2/e1 2/e2 z z e1 2/e2 x x 2/e1 taper twist bend pinch shear Pe(x, y, z) = [{( )+ ( ) } + ( ) ] rx2 + ry2 rx rx y y ry ry rz rz Function-Based 3D Object Representation

6. Look and Feel of a 3D Modeler slider controls to modify model parameters. rotation and translation controls to modify model orientation and position in space.

7. 3D Data Representation n-ary node blend struct blending{ float KTPX , KTPY ,/* tapering */ KSH ,/* shearing */ KTW ,/* twisting */ KBD ;/* bending */ float FS ;/* field strength */ } bend & rotate bend & rotate blend struct primitive { int type ;/* 0: ellipsoid, 1: torus*/ float rx , ry , rz , ra ;/* scale */ float e1 , e2 ;/* squareness */ float kTPX , kTPY ,/* tapering */ kSH ,/* shearing */ kTW ,/* twisting */ kBE ;/* bending */ float x0 , y0 , z0 ;/* primitive center */ float yaw , pitch , row ;/* rotation */ float rfu ;/* reserved for future use */ } P7 P6 blend taper unary node P5 : blend nodes : deformation nodes : primitive nodes (Pi) taper taper P4 P2 P3 P1

8. 3D Data Sharing Protocol update network implicit model Update info. polygonization polygonization polygonization polygon model polygon model polygon model rendering rendering rendering output image output image systemjsystemk user input (deformation) output image systemi

9. 3D Data Sharing Protocol Server release UR a c login b update notification request UR ACK ACK d e copy copy f Backup latest data Clientk Clientj Clienti copy new participant i participantk participantj UR : update right

10. display a set of new shapes 3D shape image to create Genetic Algorithm rate each shape create new 3D geometries by inheriting highly rated shapes and simulating natural evolutionary processes like crossover and mutation :very good :good :not good designer IEC-base 3D Modeling Concept

11. Look and Feel of IEC Interface buttons to set fitness value current fitness value

12. P5 P4 P1 P2 P3 P4 P5 P6 GA Coding of a 3D Geometric Model Chromosome inside P3 P3 type rx ry rz ra x0 y0 z0 R e1 e2 dTPX dTPY dSH dTW dBD P6 P2 0 1110 0 0 00 1 1 1 1 0 0 1 P1 Selection flag a green pepper model made of six primitives rx ry rz e1 e2 dTPX dTPY dBD Selected parameters for GA operations 01110101 　01110101　 00100110 bit string 8 bit 8 bit 8 bit

13. P5 P4 3D models render new 3D shapes represented by parameters PTYPE (phenotype) P1 = (0, 0.3, 0.3, 1.0, 0.0, 0.1, 1.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 2.20, 0.0, 0.0, 0.0), P2 = (….), P3 = (….), P2 = (….), P3 = (….), B = (….) P3 Pi: primitive parameters, B : blending parameters P6 P2 encoded as a bit-string decode back to parameters P1 chromosome Ci P1 P2 P3 P4 P5 P6 GTYPE (genotype) gene reproduce children simulate evolution Cj Ck parent Cm 10011100 01110101 10100110 Cm’ Cj’ child Ck’ mutation crossover 3D Shape Generation by Evolutionary Computation

14. Convergence Converge on a final shape with elaboration Divergence Diverge from an initial image for exploration Rough Sketch Draw a rough image of the target to create Modeling Strategy System Functionality pen Free-hand drawing of object’s shape segmentation by three superquadrics 3D model approximation 3D shape exploration using Interactive Evolutionary Computation (IEC) elaboration and finishing Fuzzy Spline Curve Identifier GA-based Shape Approximation Module IEC-based 3D Shape Explorer Parametric 3D Molder Implementation Future Enhancements More intuitive modeling operations

15. Large Arch Screen for Designers IEC modeling window 3D modeling window 200 inch arch screen Designer

16. Future Enhancements More realistic virtual environment to share on the ultra high-speed network avatars of active participants artist with wearable computer customer with mobile PC link engineering designer on a desktop system craftsman with immersive virtual environment