1 / 30

EECS 274 Computer Vision

EECS 274 Computer Vision. Radiometry. Radiometry – measuring light. Relationship between light source, surface geometry, surface properties, and receiving end (camera) Inferring shape from surface reflectance Photometric stereo Shape from shading

nelly
Download Presentation

EECS 274 Computer Vision

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. EECS 274 Computer Vision Radiometry

  2. Radiometry – measuring light • Relationship between light source, surface geometry, surface properties, and receiving end (camera) • Inferring shape from surface reflectance • Photometric stereo • Shape from shading • Reading: FP Chapter 4, S Chapter 2, H Chapter 10

  3. Radiometry • Questions: • how “bright” will surfaces be? • what is “brightness”? • measuring light • interactions between light and surfaces • Core idea - think about light arriving at a surface • Around any point is a hemisphere of directions • Simplest problems can be dealt with by reasoning about this hemisphere (summing effects due to all incoming directions)

  4. Shape, illumination and reflectance • Estimating shape and surface reflectance properties from its images • If we know the shape and illumination, can say something about reflectance (e.g., light field rendering in graphics) • Usually reflectance and shape are coupled (e.g., inverse problem in vision)

  5. Foreshortening • As a source is tiled wrt the direction in which the light is traveling  it looks smaller to a patch of surface viewing the source • As a patch is tiled wrt to the direction in which the light is traveling  it looks smaller to the source • The effect of a source on a surface depends on how the source looks from the point of view of the surface

  6. Foreshortening • Principle: two sources that look the same to a receiver must have the same effect on the receiver. • Principle: two receivers that look the same to a source must receive the same amount of energy. • “look the same” means produce the same input hemisphere (or output hemisphere) • Reason: what else can a receiver know about a source but what appears on its input hemisphere? (ditto, swapping receiver and source) • Crucial consequence: a big source (resp. receiver), viewed at a glancing angle, must produce (resp. experience) the same effect as a small source (resp. receiver) viewed frontally.

  7. Solid angle • The pattern a source generates on an input hemisphere is described by the solid angle • In a plane, an infinitesimally short line segment subtends an infinitesimally small angle

  8. Solid Angle • By analogy with angle (in radians), the solid angle subtended by a region at a point is the area projected on a unit sphere centered at that point • The solid angle subtended by a patch area dA is given by • Another useful expression in angular coordinate:

  9. Measuring Light in Free Space • The distribution of light in space is a function of position and direction • Think about the power transferred from an infinitesimal source to an infinitesimal receiver • We have total power leaving s to r = total power arriving at r from s • Also: Power arriving at r is proportional to: • solid angle subtended by s at r (because if s looked bigger from r, there’d be more) • foreshortened area of r (because a bigger r will collect more power

  10. Radiance • Amount of energy traveling at some point in a specified direction, per unit area perpendicular to the direction of travel (foreshortened area), per unit solid angle (w×m-2 × sr-1) • Small surface patch viewing a source frontally collect more energy than the same patch viewing along a nearly tangent direction • The amount of received energy depends on • How large the source looks from the patch, and • How large the patch looks from the source • A function of position and direction:

  11. Radiance (cont’d) • The square meters in the units are foreshortened (i.e., perpendicular to the direction of travel) • Crucial property: In a vacuum, radiance leaving p in the direction of q is the same as radiance arriving at q from p • which was how we got to the unit

  12. Radiance is constant along straight lines Energy emitted by the patch • Power 1->2, leaving 1: • Power 1->2, arriving at 2: • But these must be the same, so that the two radiances are equal Radiance × foreshortened area × solid angle × time Radiance leaving P1 in the direction of P2 is Radiance arriving at P2 from the direction of P1 is Solid angle subtended by patch 2 at patch 1

  13. Radiance is constant along straight lines • Power 1->2, arriving 2: • Power 1->2, arriving at 2: • But these must be the same, so that the two radiances are equal which means that so that radiance is constant along straight lines

  14. Light at surfaces • Many effects when light strikes a surface -- could be: • absorbed • transmitted • skin • reflected • mirror • scattered • milk • travel along the surface and leave at some other point • sweaty skin • Fluorescence: Some surfaces absorb light at one wavelength and radiate light at a different wavelength • Assume that • all the light leaving a point is due to that arriving at that point • surfaces don’t fluoresce (light leaving a surface at a given wavelength is due to light arriving at that wavelength) • surfaces don’t emit light (i.e. are cool)

  15. Irradiance • Describe the relationship between • incoming illumination, and • reflected light • A function of both • the direction in which light arrives at a surface • and the direction in which it leaves

  16. Irradiance (cont’d) • How much light is arriving at a surface? • Sensible unit is Irradiance • Incident power per unit area not foreshortened • A surface experiencing radiance L(x,q,f) coming in from dw experiences irradiance • Crucial property: Total power arriving at the surface is given by adding irradiance over all incoming angles --- this is why it’s a natural unit • Total power is Irradiance = radiance × foreshortening factor × solid angle

  17. The BRDF • Can model this situation with the Bidirectional Reflectance Distribution Function (BRDF) • The most general model of local reflection A surface illuminated by radiance coming in from a region of solid angle dω at angle to emit radiance

  18. BRDF • Units: inverse steradians (sr-1) • Symmetric in incoming and outgoing directions - this is the Helmholtz reciprocity principle • Radiance leaving a surface in a particular direction: • add contributions from every incoming direction of a hemisphere Ω

  19. Helmholtz stereopsis • Exploit the symmetry of surface reflectance • For corresponding pixels, the ratio of incident radiance to emitted radiance is the same • Derive a relationship between the intensities of corresponding pixels that does not depend on the BRDF of the surface

  20. Suppressing angles - Radiosity • In many situations, we do not really need angle coordinates • e.g. cotton cloth, where the reflected light is not dependent on angle • If the radiance leaving the surface is independent of exit angle, no need describing a unit that depends on direction • Appropriate unit is radiosity • total power leaving a point on the surface, per unit area on the surface (Wm-2) • note that this is independent of the exit direction • Radiosity from radiance? • sum radiance leaving surface over all exit directions, multiplying by a cosine because this is per unit area not per unit foreshortened area

  21. Radiosity • Important relationship: • radiosity of a surface whose radiance is independent of angle (e.g. that cotton cloth)

  22. Radiosity Radiosity used in rendering

  23. Suppressing angles: BRDF • BRDF is a very general notion • some surfaces need it (underside of a CD; tiger eye; etc) • very hard to measure • ,illuminate from one direction, view from another, repeat • very unstable • minor surface damage can change the BRDF • e.g. ridges of oil left by contact with the skin can act as lenses • for many surfaces, light leaving the surface is largely independent of exit angle • surface roughness is one source of this property

  24. Directional hemispheric reflectance • The light leaving a surface is largely independent of exit angle • Directional hemispheric reflectance (DHR): • The fraction of the incident irradiance in a given direction that is reflected by the surface (whatever the direction of reflection) • Summing the radiance leaving the surface over all directions and dividing it by the irradiance in the direction of illumination • unitless, range is 0 to 1 • Note that DHR varies with incoming direction • eg a ridged surface, where left facing ridges are absorbent and right facing ridges reflect.

  25. Lambertian surfaces and albedo • For some surfaces, the DHR is independent of illumination direction too • cotton cloth, carpets, matte paper, matte paints, etc. • For such surfaces, radiance leaving the surface is independent of angle • Called Lambertiansurfaces (same Lambert) or ideal diffuse surfaces • Use radiosity as a unit to describe light leaving the surface • DHR is often called diffuse reflectance, or albedo, ρd • for a Lambertian surface, BRDF is independent of angle, too. • Useful fact:

  26. Lambertian objects

  27. Non-Lambertian objects

  28. Specular surfaces • Another important class of surfaces is specular, or mirror-like. • radiation arriving along a direction leaves along the specular direction • reflect about normal • some fraction is absorbed, some reflected • on real surfaces, energy usually goes into a lobe of directions • can write a BRDF, but requires the use of funny functions

  29. Phong’s model • There are very few cases where the exact shape of the specular lobe matters. • Typically • very, very small --- mirror • small -- blurry mirror • bigger -- see only light sources as “specularities” • very big -- faint specularities • Phong’s model • reflected energy falls off with

  30. Lambertian + specular • Widespread model • all surfaces are Lambertian plus specular component • Advantages • easy to manipulate • very often quite close true • Disadvantages • some surfaces are not • e.g. underside of CD’s, feathers of many birds, blue spots on many marine crustaceans and fish, most rough surfaces, oil films (skin!), wet surfaces • Generally, very little advantage in modelling behaviour of light at a surface in more detail -- it is quite difficult to understand behaviour of L+S surfaces

More Related