Redistributions of documents, or parts of documents, must retain the FISWG cover page containing the disclaimer.

Transcription

1 Disclaimer: As a condition to the use of this document and the information contained herein, the Facial Identification Scientific Working Group (FISWG) requests notification by before or contemporaneously to the introduction of this document, or any portion thereof, as a marked exhibit offered for or moved into evidence in any judicial, administrative, legislative, or adjudicatory hearing or other proceeding (including discovery proceedings) in the United States or any foreign country. Such notification shall include: 1) the formal name of the proceeding, including docket number or similar identifier; 2) the name and location of the body conducting the hearing or proceeding; and 3) the name, mailing address (if available) and contact information of the party offering or moving the document into evidence. Subsequent to the use of this document in a formal proceeding, it is requested that FISWG be notified as to its use and the outcome of the proceeding. Notifications should be sent to: FISWG@yahoogroups.com Redistribution Policy: FISWG grants permission for redistribution and use of all publicly posted documents created by FISWG, provided that the following conditions are met: Redistributions of documents, or parts of documents, must retain the FISWG cover page containing the disclaimer. Neither the name of FISWG, nor the names of its contributors, may be used to endorse or promote products derived from its documents. Any reference or quote from a FISWG document must include the version number (or creation date) of the document and mention if the document is in a draft status. FISWG Facial Image Comparison Feature List for Morphological Analysis 0

2 Section X Facial Image Comparison Feature List for Morphological Analysis Purpose The purpose of this document is to provide a standardized facial feature list to be considered when conducting a morphological analysis. Introduction The FISWG document Guidelines for Facial Comparison Methods (see current version at states, Morphological analysis should be undertaken in a systematic manner and include a list of the features to be compared for every examination. The feature list presented in this document is intended to serve as the FISWG standard. Any reference in this document to the word face refers to features of the face, head and neck. This list includes the features of the face that may be visible and comparable between images. Features in this document are presented from top to bottom of the face, and are not provided in order of importance or priority. This document is not intended to cover the entire comparison process. Future FISWG documents will cover topics such as how much features change over time (natural, accidental and intentional), how imaging conditions (e.g., pose, illumination, expression, resolution) affect feature appearance, comparison and evaluation strategies, and conclusion scales. Facial Feature List The following feature list is divided into two sections with different levels of detail. The contents of the first section, Facial Components, are gross features considered in virtually all comparisons. The contents of the second section,, expand on the Facial Components section by providing a list of detailed features and their associated Characteristic Descriptors. Note: There are several instances in this document in which the term distance or approximate distance is used. When this term is used, FISWG does not mean to imply that the precise value of this dimension must be determined, but rather the relative size of this dimension compared to the overall width or height of the face, if not otherwise specified. FISWG recommends that photoanthropometry not be used at all due to its limitations (see current version of Guidelines for Facial Comparison Methods at Note on illustrations: In the illustrations, dotted lines indicate the relevant feature. FISWG Facial Image Comparison Feature List for Morphological Analysis 1

3 Facial Components The details of the human face can be subdivided at multiple scales. The Facial Components list provided below represents the first subdivision of the face. When imaging conditions allow, it may be possible to further subdivide these components. Any standard procedure addressing facial comparison analysis should consider all of the components identified below. ID 1 Skin Facial Components 2 Face/Head Outline 3 Face/Head Composition 4 Hairline/Baldness Pattern 5 Forehead 6 Eyebrows 7 Eyes 8 Cheeks 9 Nose 10 Ears 11 Mouth 12 Chin/Jawline 13 Neck 14 Facial Hair 15 Facial Lines 16 Scars 17 Facial Marks 18 Alterations 19 Other Facial Components: 1 Skin Skin refers to the overall appearance of the skin. 1 Skin 1.1 Overall Skin Appearance Overall Texture Overall Tone: e.g. luminance and color FISWG Facial Image Comparison Feature List for Morphological Analysis 2

4 Facial Components: 2 Face/Head Outline Face/Head Outline refers to the overall shape of the head and face. 2 Face/Head Outline 2.1 of Cranial Vault Portrait Contour Profile Contour 2.2 Overall of Face Portrait Contour Profile Contour FISWG Facial Image Comparison Feature List for Morphological Analysis 3

5 Facial Components: 3 Face/Head Composition Face/Head Composition refers to the overall configuration of the facial components, to include their alignment and relative sizes, internal to a single face. 3.1 Proportions/Position of Features on Face 3 Face/Head Composition Approximate width of nose relative to eye distances (e.g., interpupillary distance, individual eye width, or overall distance between outer corners) Approximate width of mouth relative to eye distances Approximate width of nose relative to mouth Approximate distance from nose to upper lip relative to face length Approximate distance from chin to lower lip relative to face length Ear position relative to eyes, nose, and mouth Eye position relative to face length Illustration 3.1a shows some of the traditional canons for ideal facial proportions (Vegter and Hage, 2000). Not all faces will conform to the proportions presented in this diagram. In this illustration: A. The face can be divided into three equal parts: hairline to nasal root (bridge), nasal root to nasal base, and nasal base to chin; B. The width of the chin is the same as the width of the mouth; C. The distance between the inner corners of the eyes is equal to the width of one eye; D. The mentolabial sulcus is half the distance from the nasal base to the chin. FISWG Facial Image Comparison Feature List for Morphological Analysis 4

6 Illustration 3.1b shows examples of alterations to the positions among facial components and the effect those positions have on the overall face/head composition. A. This face shows the proportions as they are presented in the previous illustration. B. The eyes and eyebrows have been moved toward the midline (medially) and the tip of the nose, the lips and philtrum have been raised toward the nose. C. The eyes and eyebrows have been raised, and the tip of the nose, the lips and philtrum have been moved down. D. The eyes and eyebrows have been moved away from the midline and the lips have been made smaller. The overall face shape has not been modified in any of the illustrations. FISWG Facial Image Comparison Feature List for Morphological Analysis 5

7 Facial Components: 4 Hairline/Baldness Pattern Version Hairline/Baldness Pattern refers to the shape and distribution of hair along top and side of the forehead to the top of the ears, to include gaps on the crown and sides of the head. 4 Hairline/Baldness Pattern 4.1 Forehead Hairline Detailed (e.g. symmetry, widow s peak, part line, cowlick ) 4.2 Hairline Right Side 4.3 Hairline Left Side Detailed 4.4 Cranial Baldness Pattern Detailed and distribution FISWG Facial Image Comparison Feature List for Morphological Analysis 6

8 Facial Components: 5 Forehead Forehead refers to the part of the face above the orbits, including the brow ridges. 5 Forehead 5.1 Forehead Relative height Relative width Slope/contour (visible in profile) 5.2 Brow Ridges Prominence Continuity FISWG Facial Image Comparison Feature List for Morphological Analysis 7

9 Facial Components: 6 Eyebrows Eyebrows refers to the strips of hair above the eye sockets. 6 Eyebrows 6.1 Right Eyebrow 6.2 Left Eyebrow 6.3 Asymmetry Between Right and Left Eyebrows (may include detailed observations) (width and length of eyebrow relative to eye size) Lateral eyebrow vertical end position relative to medial eyebrow vertical position (tilt of eyebrow) ( A in illustration) Vertical end position of lateral eyebrow relative to the lateral canthus ( B in illustration) Vertical end position of medial eyebrow relative to the medial canthus ( C in illustration) Horizontal end position of lateral eyebrow relative to lateral canthus ( D in illustration) Horizontal end position of medial eyebrow relative to medial canthus ( E in illustration) Conjoined left-right eyebrows ( unibrow ) Density of hair within eyebrow and distribution of density Hair details (e.g. texture, length, thickness, shape, color) Noticeably longer hairs e.g. overall shape, size, position, and hair details (see individual eyebrow Descriptors) Illustration 6.1 (6.2) shows the position of the eyebrow relative to the position of the eye opening. A. Lateral eyebrow vertical end position relative to medial eyebrow vertical position. B. Vertical end position of lateral eyebrow relative to the lateral canthus. C. Vertical end position of medial eyebrow relative to the medial canthus. D. Horizontal end position of lateral eyebrow relative to the lateral canthus. E. Horizontal end position of medial eyebrow relative to the medial canthus. Facial Components: 7 Eyes Eyes refers to the ocular region below the eyebrows and above the cheeks. FISWG Facial Image Comparison Feature List for Morphological Analysis 8

10 7 Eyes 7.1 Inter-Eye Distance Distance between right and left eye 7.2 Right Eye Fissure Opening 7.3 Left Eye Fissure Opening (Outline) 7.4 Right Upper Eyelid 7.5 Left Upper Eyelid (Including Lashes) 7.6 Right Lower Eyelid 7.7 Left Lower Eyelid (Including Lashes) 7.8 Right Eyeball Prominence 7.9 Left Eyeball Prominence 7.10 Right Eye Sclera 7.11 Left Eye Sclera 7.12 Right Iris 7.13 Left Iris 7.14 Right Eye Medial Canthus 7.15 Left Eye Medial Canthus 7.16 Right Eye Lateral Canthus 7.17 Left Eye Lateral Canthus 7.18 Asymmetry Between Right and Left Eyes Angle (angle from inner corner and outer corner [when eyes are horizontal]) Prominence (e.g. visibility, folds) Protrusion Visibility of the crease above the upper eyelid (superior palpebral furrow) Position in relation to iris and/or pupil Lash characteristics (e.g. length, density, flow, irregular) Prominence (e.g. visibility, folds) Protrusion Visibility of the crease below the lower eyelid (inferior palpebral furrow) Visibility of infraorbital furrow (a place where a line or wrinkle may appear parallel to and below the lower eyelid running from near the inner canthus and following cheek bone laterally) Position in relation to iris and/or pupil Lash characteristics (e.g. length, density, flow, irregular) Degree of Protrusion Visibility of blood vessels and defects Color Color Visibility Diameter relative to eye opening Position relative to eye opening (in front view) Irregularity in pupil Caruncle (fleshy prominence at inner eye corner) and angle of inner corner of the eye and angle of outer corner of the eye, Angle Off-set (e.g. one eye higher than the other) Eyelids (e.g. one drooping, one retracted) & Eyelashes Color Iris and pupil position (i.e. cross-eyed) e.g. overall shape, size, position, and hair details (see individual eyebrow Descriptors) FISWG Facial Image Comparison Feature List for Morphological Analysis 9

11 (7.5) 7.2 (7.3) 7.14 (7.15) 7.6 (7.7) 7.12 (7.13) 7.10 (7.11) 7.16 (7.17) FISWG Facial Image Comparison Feature List for Morphological Analysis 10

12 7.8 (7.9) Illustration 7.8 (7.9) shows the anterior (forward) projection of the eyes. A shows an eye with minimal prominence (projection forward from the socket), whereas B shows an eye with significant prominence (7.15) 7.16 (7.17) FISWG Facial Image Comparison Feature List for Morphological Analysis 11

13 Facial Components: 8 Cheeks Cheeks refers to the regions surrounded by the eyes, ears, nose, mouth, chin and jawline. 8.1 Right Cheekbone 8.2 Left Cheekbone 8.3 Right Cheek 8.4 Left Cheek (Soft Tissue) 8 Cheeks Prominence Presence of dimple Facial Components: 9- Nose Nose refers to the entire nasal region. 9 Nose 9.1 Nasal Outline (Profile and Front view) Overall Length and/or width relative to rest of face Prominence Symmetry 9.2 Nasal Root (Bridge) Front View: width, length, shape, depth Profile View: length, depth, angle 9.3 Nasal Body Front View: width, length, shape, angle Profile View: length, angle, contour 9.4 Nasal Tip (in front and profile view) Angle (e.g. up, down) Symmetry 9.5 Nasal Base Width Height Deviation to the right or left 9.6 Nasal Base: Alae (Wings of Nose) Thickness Symmetry 9.7 Nasal Base: Nostrils (Nasal Openings) and size of opening Symmetry Hair 9.8 Nasal Base: Columella (Soft Tissue between Nostrils) Width and length Relative position Symmetry FISWG Facial Image Comparison Feature List for Morphological Analysis 12

14 9 Nose FISWG Facial Image Comparison Feature List for Morphological Analysis 13

15 Facial Components: 10 Ears Ears refers to the external characteristics of the ears Asymmetry Between Left and Right Ears 10.2 Right Ear Protrusion 10.3 Left Ear Protrusion 10.4 Overall Right Ear 10.5 Overall Left Ear 10.6 Right Ear Helix Superior/Inferior (Tail) 10.7 Left Ear Helix Superior/Inferior (Tail) 10.8 Right Ear Tubercles (Auricular Tubercle) 10.9 Left Ear Tubercles (Auricular Tubercle) Right Ear Antihelix Left Ear Antihelix Right Ear Crura of Antihelix (Superior, Inferior) Left Ear Crura of Antihelix (Superior, Inferior) Right Ear Triangular Fossa Left Ear Triangular Fossa Right Ear Crus of Helix Left Ear Crus of Helix Right Ear Scaphoid Fossa Left Ear Scaphoid Fossa Right Ear Concha (Superior, Inferior) Left Ear Concha (Superior, Inferior) Right Ear Tragus Left Ear Tragus Right Ear Antitragus Left Ear Antitragus Right Ear Intertragic Notch Left Ear Intertragic Notch Right Ear Anterior Knob Left Ear Anterior Knob 10 Ears Protrusion Positioning (e.g. One is above the other) Extent of Protrusion Angle Quantity Protrusion Protrusion FISWG Facial Image Comparison Feature List for Morphological Analysis 14

16 10.30 Right Ear Anterior Notch Left Ear Anterior Notch Right Ear Posterior Auricular Furrow Left Ear Posterior Auricular Furrow Right Ear Lobule (Lobe) Left Ear Lobule (Lobe) 10 Ears Attached or Detached Ear Abnormalities e.g. Cleft lobe; cauliflower FISWG Facial Image Comparison Feature List for Morphological Analysis 15

17 10.6 (10.7) (10.19) (10.11) (10.13) Superior Crus (10.15) (10.13) Inferior Crus (10.21) (10.17) (10.23) (10.21) (10.25) (10.27) (10.33) (10.35) (Unattached) 10.8 (10.9) (10.30) (10.29) (10.35) Attached FISWG Facial Image Comparison Feature List for Morphological Analysis 16

18 Facial Components: 11- Mouth Mouth refers to the entire oral region including the teeth and encompasses the philtrum. 11 Mouth 11.1 Philtrum Prominence Width of ridges Width of furrow Symmetry 11.2 Overall Mouth Symmetry 11.3 Upper Lip Fullness Protrusion Symmetry Upper Vermilion Border (e.g. Cupid's bow ) and definition Detail (e.g. tubercle, lip creases, alae) 11.4 Lower Lip Fullness Protrusion Symmetry Lower Vermilion Border & definition Detail (e.g. median sulcus, tori, lip creases) 11.5 Lip Fissure (Opening between Lips) Symmetry Degree of contact/occlusion along length of opening Corners/angles of mouth (Labial Commissure) 11.6 Mouth Asymmetry Difference between left and right sides 11.7 Overall Dental Occlusion (Contact between Upper and Lower Teeth) 11.8 Prognathism (Forward protrusion of mouth complex) Symmetry Degree of contact/occlusion Degree 11.9 Characteristic Detail of Teeth Alignment/Position (e.g. gaps, crooked, missing) Condition (e.g. wear, damage, disease, color) Mouth Abnormalities Cleft Lip A congenital deformity caused by abnormal facial development during gestation FISWG Facial Image Comparison Feature List for Morphological Analysis 17

19 Upper Vermilion Border Lower Vermilion Border FISWG Facial Image Comparison Feature List for Morphological Analysis 18

20 Facial Components: 12 Chin/Jawline Chin/Jawline refers to the area of the face defined by the lower border of the mandible (a.k.a. "jaw bone"). The chin is the area on the lower jaw below the mouth. Jawline specifically refers to the area of the face defined by the lower border of the mandible between the chin and the Gonial Angle, or the point at which the lower border of the mandible abruptly changes direction from a primarily horizontal line to a primarily vertical line. 12 Chin/Jawline 12.1 Chin (Profile and Frontal view) Overall Length and/or width relative to rest of face Prominence Symmetry Details (e.g. cleft, dimple, mental groove; refer to wrinkles and folds) 12.2 Jawline (from Chin to Gonial Angle) Definition (e.g. jowls) 12.3 Gonial Angle (Angle of the Jaw) Definition FISWG Facial Image Comparison Feature List for Morphological Analysis 19

21 Facial Components: 13 Neck Neck refers to the transitional zone between the head and the trunk and limbs of the body. 13 Neck 13.1 Neck (Overall) Width Height Details (e.g. musculature, veins, wrinkles, folds, wattle, double chin ) 13.2 Laryngeal Prominence (Adam's Apple) Prominence Location on neck FISWG Facial Image Comparison Feature List for Morphological Analysis 20

22 Facial Components: 14 Facial Hair Facial Hair refers to hair on the face, typically covering the cheeks, chin/jaw, upper and lower lip, and neck of the face Facial Hair Above Upper Lip 14.2 Facial Hair Below Lower Lip 14.3 Facial Hair on Right Side 14.4 Facial Hair on Left Side 14.5 Facial Hair on Neck, below Chin/Jawline 14 Facial Hair /Spatial distribution (including overall hair length) Texture Symmetry Density and distribution of density including gaps Variation in color/tonality Orientation (slanted, straight) Outline/edge definition (e.g., sharp, irregular) Continuity with facial hair on side(s) or below/above mouth Noticeably Longer Hairs /Spatial distribution (including overall hair length) Texture Symmetry Density and distribution of density including gaps Variation in color/tonality Orientation (slanted, straight) Outline/edge definition (e.g., sharp, irregular) Continuity with facial hair above or below mouth Noticeably Longer Hairs /Spatial distribution (including overall hair length) Texture Symmetry Density and distribution of density including gaps Variation in color/tonality Orientation (slanted, straight) Outline/edge definition (e.g., sharp, irregular) Continuity with facial hair on side(s) or below mouth Noticeably Longer Hairs Facial Components: 15 Facial Lines Facial lines are described as wrinkles, folds or creases. Creases or folds are determined by craniofacial structure. Other lines, such as wrinkles, are age-related and are caused by muscle action, loss of elasticity of the skin and/or loss of subcutaneous fat/teeth at sunken areas. The FISWG Facial Image Comparison Feature List for Morphological Analysis 21

23 following list represents the most common facial lines and is not an exhaustive list. Special attention should be paid to any lines that do not correspond to those listed below. 15 Facial Lines 15.1 Forehead Creases (Wrinkles) Distribution Orientation (vertical or horizontal) Quantity Pattern (Including relation to one another) Depth/Prominence 15.2 Vertical Glabellar Line(s) Length Pattern (including relation to one another) Depth/Prominence 15.3 Nasion Crease Distribution Quantity Pattern (Including relation to one another) Depth/Prominence 15.4 Bifid Nose Crease Depth/Prominence Length 15.5 Wrinkles Adjacent to Right Eye (Crow's Feet) 15.6 Wrinkles Adjacent to Left Eye (Crow's Feet) 15.7 Right Superior Palpebral Crease 15.8 Left Superior Palpebral Crease (Crease between the Upper Eyelid and the Top of the Bony Orbit) 15.9 Right Lower Lid Crease Left Lower Lid Crease (Crease between the Lower Eyelid and the Bottom of the Bony Orbit) Right Infraorbital Creases Left Infraorbital Creases (Creases below the Eyes) Upper Lip Creases (Vertical Wrinkles above Upper Lip) Lower Lip Creases (Vertical Wrinkles below Lower Lip) FISWG Facial Image Comparison Feature List for Morphological Analysis 22 Distribution Quantity Pattern (Including relation to one another) Depth/Prominence Visibility Position Depth/Prominence Visibility Position Depth/Prominence Distribution Quantity Pattern (Including relation to one another) Depth/Prominence Distribution Quantity Pattern (Including relation to one another) Depth/Prominence Distribution Quantity Pattern (Including relation to one

24 15.15 Mentolabial Sulcus (Horizontal Crease or Fold between Lower Lip and Chin) Right Nasolabial Crease/Folds Left Nasolabial Crease/Folds (Creases or Folds extending from Nose to Corners of Mouth) Right Marionette Lines Left Marionette Lines 15 Facial Lines another) Depth/Prominence Length Depth/Prominence Distribution Quantity Pattern (Including relation to one another) Depth/Prominence Pattern Depth/Prominence Cleft Chin Depth/Prominence Right Buccal Creases/Folds Left Buccal Creases/Folds (Cheek to Chin) Distribution Quantity Pattern (Including relation to one another) Depth/Prominence Wrinkles on Neck Distribution Quantity Pattern (Including relation to one another) Depth/Prominence (See next page for Facial Lines Illustration) Facial Components: 16 Scars Scars are discolored areas of skin where permanent damage has healed (i.e. not recent damage). These areas may occur at any place on the face since they are typically caused by random trauma. 16 Scars 16.1 Scars Location Orientation Color/Tonality Depth/Prominence FISWG Facial Image Comparison Feature List for Morphological Analysis 23

25 FISWG Facial Image Comparison Feature List for Morphological Analysis 24

26 Facial Components: 17 Facial Marks Facial marks are portions of skin such as freckles, moles, acne, rosacea, birth marks, bruises, abrasions, vitaligo, dark/light patches, etc. which contain a different level of pigment than the rest of the surrounding skin. These areas may occur at any place on the face since they are typically random in nature. Some facial marks, such as acne, bruises, abrasions, etc. are transient features, which require contemporaneous images for comparison Skin Marks (e.g. freckles, moles, acne, rosacea, birth marks, bruises, abrasions, vitaligo, dark/light patches, etc.) 17 Facial Marks Facial Components: 18 Alterations Refers to any intentional modification to the face. 18 Alterations Location/Distribution (Including relation to one another) Color Prominence 18.1 Piercing Location Description 18.2 Makeup Location Description (,, Color, etc.) 18.3 Tattoo (Including Cosmetic) 18.4 Other Location Description Facial Components: 19 Other Location Description (Content,,, Color, etc.) The suite of components and characteristics identified above should be sufficient to address the vast majority of faces encountered in facial comparison situations. However, in some instances there may be deformities or other irregularities on a face that do not conform to this set of features. In such instances, it will be necessary to include these irregular features in the analysis. Given the unconstrained range of possibilities that this component set represents, FISWG has simply labeled this as Other. Detailed Feature Characteristic List 19 Other Feature Attribute List 19.1 Other text Description and Details FISWG Facial Image Comparison Feature List for Morphological Analysis 25

27 Reference List Vegter, F. and J. Hage, Clinical Anthropometry and Canons of the Face in Historical Perspective, Plastic and Reconstructive Surgery, Vol. 106, No. 5, , FISWG Facial Image Comparison Feature List for Morphological Analysis 26

28 FISWG documents can be found at: Section Section 1 Section 2 Section 3 Section 4 Section 5 Section 6 Section 7 Title Glossary Facial Comparison Overview Guidelines and Recommendations for Facial Comparison Training to Competency Guidelines for Specifications, Procurement, Deployment, and Operations of Facial Recognition Systems Capture and Equipment Assessment for Facial Recognition Systems Guidelines for Facial Comparison Methods Recommendations for a Training Program in Facial Comparison Section 8 Section 9 Section 10 FISWG Facial Image Comparison Feature List for Morphological Analysis 27