150 likes | 262 Views
AMP Real Estate Broker Simulation Examination Derivation of Test Specifications. Jeffrey A. Kelley, PhD Applied Measurement Professionals. Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona. Simulation Overview.
E N D
AMP Real Estate Broker Simulation ExaminationDerivation of Test Specifications Jeffrey A. Kelley, PhD Applied Measurement Professionals Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Simulation Overview • Simulations help assess skills based on realistic real estate issues • The intent is to test job-related aspects of real estate that cannot be tested with multiple-choice items Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Simulation Overview • Problems follow a transaction from start to finish (path) • Scenario • Information gathering • Decision making DM Scenario DM DM DM IG DM & Close DM IG Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Simulation Scoring • Facilitative options may receive scores of +3, +2, or +1 • Uninformative, wasteful, or unnecessarily invasive or inappropriate options may receive scores of –1, –2, or –3 Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
The Simulation Experience… Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Job Analysis Survey • Sent to a sample of 12,337 real estate professionals • Received responses from 776 brokers and 427 salespersons • 166 real estate job tasks and 16 real estate major issues rated for significance • Task ratings used to develop multiple choice examinations • Issue ratings used to develop the simulation examination specifications Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
How significant are the following issues to your real estate practice? (use the following scale) 0 = Not performed 1 = Not significant 2 = Somewhat significant 3 = Quite significant 4 = Extremely significant Advertising Agency/Non-Agency Relationships Asset Management (commercial brokerage) Disclosures (including stigmatized property) Document Preparation Ethics FederalLaws/ Environmental Issues Finance Marketing of Services Negotiation Property Management Property Representations Risk Management Training/Supervision of Licensees Trust Accounts Valuation Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Inclusion Criteria • Issues with a mean significance rating below 2.15 were removed from consideration • asset management • property management Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Primary v. Secondary Issues • Each problem is classified by one primary issue • Each section within the problem is classified by a secondary issue, which may or may not be the same as the primary Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
National Broker Simulation Test Specifications – Effective 2006 Eight Scored Simulation Problems (+ 2 pretest problems) One issue is designated as the primary issue for the problem; one property type is also designated. Problems will address several issues, up to one issue for each section in the problem. Within the eight problems all 15 issues must be addressed at least once. Ethics must be addressed in at least four problems. The five bolded issues must be the primary issue for at least one problem per examination. The distribution by property types is as follows: Residential (3), Commercial (2), Property management (1), unspecified (2). Agency/Non Agency Relationships Disclosures (including stigmatized property) Property Representations Trust Accounts Training/Supervision of Licensees Risk Management Ethics Negotiation Document Preparation Fair Housing Environmental Issues Representation of Services Valuation Advertising Finance Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Modifications • Federal Laws/Environmental Issues split into separate issues • Federal Laws renamed as Fair Housing • The Advisory Board felt that Fair Housing was the pertinent legal issue and wanted to limit the scope • Environmental Issues were felt to be clearly distinct from Fair Housing, and warranted a separate issue • Marketing of Services renamed as Representation of Services Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Designation of Required Primary Issues • The consensus opinion of the advisory board was that most license law violations were related to these five issues Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Property Types Dimension • The Advisory Board wanted to ensure representation for all property types that licensees are allowed to deal in Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Next Steps • Pilot testing beginning in October • Implementation in Spring 2006 Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona
Speaker Contact Information Jeff Kelley Applied Measurement Professionals 8310 Nieman Rd, Lenexa, KS 66214 Phone (913) 541-0400 Fax (913) 541-0156 jkelley@goamp.com www.goamp.com Presented at the 2005 CLEAR Annual Conference September 15-17 Phoenix, Arizona