1.16k likes | 1.18k Views
Welcome to the Data Warehouse. Assessing. HOME. HELP. Success. Synthia LaFontaine. Assessments. Welcome to the Data Warehouse. HOME. HELP. TEACHING TOOLS. Document Learning Progress. ASSESSING SUCCESS. Welcome to the Data Warehouse. Create Assessments Purpose/Format
E N D
Welcome to the Data Warehouse Assessing HOME HELP Success Synthia LaFontaine
Assessments Welcome to the Data Warehouse HOME HELP TEACHING TOOLS Document Learning Progress ASSESSING SUCCESS
Welcome to the Data Warehouse Create Assessments Purpose/Format Cognitive levels Learning Objectives Questions/Responses HOME HELP PURPOSE
PLACEMENT Teachers See Where to Start Students Clarify and Set Goals Teachers Assign Cooperative Groups/Roles FORMATIVE Students Focus Efforts Students Gain Confidence Teachers See What Works Best Teachers See What/Who to Reteach DIAGNOSTIC Identify Problems Understand Difficulties SUMMATIVE Teachers See What Works Best Students Celebrate Achievement Students Set New Goals Confidently Welcome to the Data Warehouse HOME HELP GRADES GRADES PURPOSE
Assessments FORMAT Welcome to the Data Warehouse HOME HELP FORMAT
FORMAT Short Answer Completion True False Matching Multiple Choice Essay Short Response Extended Response Performance Task LENGTH Time Purpose Resources Testing Evaluation Welcome to the Data Warehouse HOME HELP FORMAT Assessing Success
Assessments COGNITIVE LEVELS Welcome to the Data Warehouse HOME HELP COGNITIVE LEVELS
COGNITIVE COMPLEXITY FCAT items assess Sunshine State Standards, and are designed to comply with Goal 3/Standard 4 of Florida’s System of School Improvement and Accountability: Florida students use creative thinking skills to generate new ideas make the best decisions recognize and solve problems through reasoning interpret symbolic data develop efficient techniques for lifelong learning Welcome to the Data Warehouse HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse COGNITIVE COMPLEXITY Cognitive effort needed Not the same as item difficulty Not related to distractors HOME HELP Levels Cognitive Demand Low Single Step to solve Moderate Mutliple Steps needed High Multiple Steps and/or Analyze, Synthesize COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT SSS READING Percentage of Points by Cognitive Complexity Level HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT SSS Reading Low Complexity Recall, observe, question, represent basic facts Demonstrate simple skills/abilities Require basic understanding of text Verbatim recall from text or simple understanding of a single word or phrase Skills Identify meaning of grade-level words Locate details in text, graph, chart, or diagram Recognize order of events Identify figurative language HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT SSS Reading Moderate Complexity Two-steps: 1. text comprehension, 2. processing Simple inferences within text Summarize, infer, classify, gather, organize, compare, display, explain, describe, interpret Skills: Use context clues to identify unfamiliar word meaning Determine how details support main idea Interpret information in graphs, charts, and diagrams Identify cause-and-effect relationships Determine author’s main purpose or point of view Identify similarities and differences Demonstrate understanding of plot development Recognize elements of plot Recognize patterns of organization Summarize the major points of a text Compare word meanings HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse HOME FCAT SSS Reading High Complexity Explain, generalize, make multiple connections Several steps with abstract reasoning & planning Support conclusions Identify theme, implicit main idea, make complex inferences within or across text Take information from at least one portion of the text and apply to a new task Perform complex analyses of connections among texts Skills Analyze the use of figurative language Show how graphs, charts, and diagrams contribute to a text Determine author’s purpose/point of view/describe how it affects text Evaluate strong vs. weak arguments Analyze similarities and differences Describe and analyze characteristics of various types of literature Describe and illustrate how common themes are found across texts Analyze cause-and-effect relationships HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT SSS MATH Percentage of Points by Cognitive Complexity Level HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT Mathematics Low Complexity Recall, recognition: learned concepts & principles Skills: • solve a one-step problem • compute a sum, difference, product, quotient • evaluate a variable expression, given specific values for the variables • recognize or construct equivalent representation • recall or recognize a fact, term, or property • retrieve information from graph, table, figure • identify appropriate units/tools for common measurements • perform a single-unit conversion HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT Mathematics Moderate Complexity Flexible thinking/choice among alternatives More than a single step Reasoning/problem-solving strategies to decide what to do Combine skill & knowledge from various domains Skills • solve a problem requiring multiple operations • solve a problem involving spatial visualization and/or reasoning • select and/or use different representations, depending on situation and purpose • retrieve information from a graph, table, or figure and using it to solve a problem • determine a reasonable estimate • extend an algebraic or geometric pattern • provide a justification for steps in a solution process • compare figures or statements • represent a situation mathematically in more than one way • formulate a routine problem, given data and conditions HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT Mathematics High Complexity More abstract reasoning, planning, analysis, judgment, & creative thought Think in an abstract and sophisticated way Skills • perform procedures with multiple steps & decision points • solve a non-routine problem (as determined by grade-level) • solve a problem in more than one way • describe how different representations can be used for different purposes • generalize an algebraic or geometric pattern • explain and justify a solution to a problem • describe comparing and contrasting solution methods • provide a mathematical justification • analyze similarities & differences between procedures & concepts • formulate an original problem, given a situation • formulate a mathematical model for a complex situation • analyze or produce a deductive argument HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT SSS SCIENCE Percentage of Points by Cognitive Complexity Level HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT Science Low Complexity Recall and recognition of previously learned concepts and principles Items typically specify what the student is to do Carry out a procedure that can be performed mechanically Skills Identify a common example or recognize a concept Retrieve information from a chart, table, diagram, or graph Recognize a standard scientific representation of a simple phenomenon Calculate or complete a familiar single-step procedure or equation using a reference sheet HOME HELP COGNITIVE LEVELS
FCAT Science Moderate Complexity More flexible thinking More than a single step or thought process Reasoning and problem-solving strategies to decide what to do Knowledge from various domains Skills Apply or infer relationships among facts, terms, properties, or variables Describe examples & non-examples of scientific processes or concepts Predict or determine logical next step/outcome Compare or contrast structures or functions of different organisms or systems Choose appropriate formula or equation to solve a problem & then solve it Apply/use concepts from a standard scientific model or theory Welcome to the Data Warehouse HOME HELP COGNITIVE LEVELS
FCAT Science High Complexity Heavy demands on student thinking Abstract reasoning, planning, analysis, judgment, and creative thought Skills Construct models for research Generalize or draw conclusions Design an experiment, given data and conditions Explain or solve a problem in more than one way Provide justification for steps in a solution or process Analyze an experiment to identify a flaw and propose a method for correcting it Interpret, explain, or solve a problem involving spatial relationships Predict a long-term effect, outcome, or result of a change within a system Welcome to the Data Warehouse HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT SSS SCIENCE Percentage of Points by Cognitive Complexity Level HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT SSS Writing+ Low Complexity Recall & recognize of learned concepts/principles Does not include complex synthesis or analysis but involves understanding of simple facts Recognize traits that distinguish something as a member of a category Demonstrate simple skills or abilities Prewriting process of grouping ideas or words (as in a brainstorming activity) Simple spelling or vocabulary tasks Compose simple sentences Perform familiar, mechanical tasks Basic understanding of the writing process Skills • categorize information • insert end punctuation in a sentence • add an –s to change a word from singular to plural HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse HOME FCAT SSS Writing+ Moderate Complexity More flexibility of thinking and choice among alternatives Student decides what to do Apply knowledge about the elements of writing Process and manipulate text Skills • determine the relevance, placement, or quality of detail • apply the purpose for writing to the task • apply knowledge of conventions HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT SSS Writing+ High Complexity Explain, generalize, or make multiple connections Abstract reasoning & planning Focus, organization, support, & conventions to demonstrate understanding of the writing situation—including the intended audience, occasion, or purpose—as a prerequisite to recognizing and producing effective writing Demonstrate insightful and involved with the subject knowledge of writing Apply skills to accomplish a new task, such as a demand writing situation in which the prompt or stimulus for writing is unknown to the student beforehand and cannot be read to or interpreted for the student Support conclusions HOME HELP COGNITIVE LEVELS
Welcome to the Data Warehouse FCAT SSS Writing+ High Complexity (continued) Mature command of language and complex sentence structures Show synthesis and analysis Integration and evaluation of appropriate compositional elements Analyze the presentation and maintenance of a central theme, topic, or unifying point Make a complex inference within or across compositions Skills • evaluate the effectiveness of a written response according to audience and purpose • develop a composition using the writing process • analyze and apply complex conventions HOME HELP COGNITIVE LEVELS
Assessments LEARNING OBJECTIVES Welcome to the Data Warehouse HOME HELP LEARNING OBJECTIVES
1 Knowinformation 1 Understandinformation’s meaning 1 Applyinformation to solve problems 2 Analyze information’s components, relationships, consequences 2 Evaluate ideas, theories, opinions; make and justify choices 2 Synthesizecomponents to create new products and ideas; combine elements in novel ways Based on Bloom’s Taxonomy Welcome to the Data Warehouse HOME HELP LEVELS & OBJECTIVES
Welcome to the Data Warehouse KNOW Instructional Objective: Identify, Select, Write a definition of, Draw, Label, Name, List, Outline Typical Questions: Who is the author of the story? What is the LAST thing Sara packs? When does hurricane season begin? Where is the capital of Florida? Why must some foods be refrigerated? How are surgical instruments sterilized? How many countries are in Asia? Who invented the light bulb? What is the definition of plagiarism? Which is the tallest mountain? HOME HELP LEVELS, OBJECTIVES, EXAMPLE QUESTIONS
Welcome to the Data Warehouse UNDERSTAND Explain, Describe, Distinguish, Interpret Who is hurt by ozone depletion? What is the LAST operation to perform? When will the birds migrate again? Where would it be safest to start a fire? Why are there primary elections? How will the game be designed? How much money does Jake need? Who is considered the most reliable? What is the BEST summary of the story? Which is the least difficult route? HOME HELP LEVELS, OBJECTIVES, EXAMPLE QUESTIONS
APPLY Solve, Determine, Find, Ascertain Who should stay for extra practice? What lesson did Sara learn in the story? When will the next lunar eclipse occur? Where is the least population growth? Why does Marc cry Tuesday morning? How is Tim’s skateboard recovered? How much gasoline tax is paid annually? Who trusts Beth the most? What is the MAIN IDEA of the passage? Calculate the total area of the 9 rooms without closets and common areas. Welcome to the Data Warehouse HOME HELP LEVELS, OBJECTIVES, EXAMPLE QUESTIONS
Welcome to the Data Warehouse ANALYZE Explain, Interpret, Analyze Who caused the problem? What is the BEST estimate of damage? When should the president resign? Where is the weather mildest? Why do the children flee from the farm? How could the paper cost be reduced? How many players support Cari’s decision? Which events could not have happened? If. ..happened, what might the ending have been? How is...similar to...? What was the turning point? What was the problem with...? HOME HELP LEVELS, OBJECTIVES, EXAMPLE QUESTIONS
Welcome to the Data Warehouse EVALUATE Evaluate, Explain, Judge Which outcome would Alicia prefer? Why does Dania need to talk with April? When is the best time to skateboard? What changes would improve the outcome for…? How effective are...? What are the consequences of...? What influence will....have on our lives? What are the pros and cons of....? Why is ....of value? What are feasible alternatives to…? Who will benefit most from…? How will…help…? HOME HELP LEVELS, OBJECTIVES, EXAMPLE QUESTIONS
Welcome to the Data Warehouse SYNTHESIZE Synthesize, Conclude, Determine How did the forest change over the 20 years discussed? What would have happened if Judge Lee had been the first judge? Which design would have been better for….? Which is the best possible solution ...? Which resources would be needed to…? How could the parts be combined to…? What would happen if ...? Which combination would NOT offer a possible solution? HOME HELP LEVELS, OBJECTIVES, EXAMPLE QUESTIONS
Assessments QUESTIONS RESPONSES Welcome to the Data Warehouse HOME HELP ASSESS COGNITIVE LEVELS QUESTIONS AND RESPONSES
Welcome to the Data Warehouse STEMS/QUESTIONS Assess Learning Objective – Precisely, Objectively Define the Problem – Meaningfully, Independently Describe the Problem – Concisely, Understandably Avoid Suggesting Response – Format, Language Observe Logical Rules – Content, Construct Maintain Academic Language – Formal, Relative HOME HELP QUESTIONS AND RESPONSES
Welcome to the Data Warehouse Meaningfully Define Problem HOME HELP • South America • is a flat, arid country • imports coffee • has a large population • was settled by Spanish colonists • South America was settled by colonists from • France. • Spain. • England. • Holland. MEANINGFUL, INDEPENDENT
Welcome to the Data Warehouse Concisely State Problem HOME HELP POOR • How would you account for the large number of Spanish colonists settling in South America? • Spanish colonists settled most of South America in search of • adventure. • wealth. • lower taxes. • religious freedom. CONCISE, UNDERSTANDABLE
Welcome to the Data Warehouse AVOID CLUES HOME HELP • A porpoise is an • plant. • b. reptile. • c. animal. • d. bird. • Shelly used the device to stop some • ant. • insects. • dolphin. • baboon. POOR POOR AVOID CLUES
Welcome to the Data Warehouse QUESTIONS HOME CONTENT ISSUES Age Race Crime Status Politics Gender Cruelty Culture Religion Violence Message Weapons Romance Private Issues CONSTRUCT ISSUES Tone Topic Length Positive Grammar Language Consistency Punctuation HELP QUESTIONS AND RESPONSES
RESPONSES Answer CLEAR if objective is met Consider __Length __Location __Language __Phrasing __Grammar __Consistency __All are PLAUSIBLE Welcome to the Data Warehouse HOME HELP Determiners Only Always Never Usually Sometimes Often QUESTIONS AND RESPONSES
To be ecstatic means • Joyful. • Electricity. • To shave. • To be happy. • Florida is a ____ state. • southern. • northern. • peninsular. • eastern. • What is the opposite of together? • A part. • Whole. • Partial. • Separate. Welcome to the Data Warehouse Capitalization Phrasing Consistency HOME HELP Punctuation Phrasing Consistency Capitalization Punctuation Two answers? PROBLEMS
School is • difficult. • important. • only for scholars. • it helps people. • A dictionary is used • daily in school • to define words • it lists synonyms • as a booster seat • Where is the Statue of Liberty? • Nevada • France • New York • in the The Grand Canyon Welcome to the Data Warehouse Negative Message Phrasing HOME HELP Phrasing Punctuation Consistency Multiple answers Consistency PROBLEMS
One way to make better use of your time is to • play it by ear. • set daily goals. • take no breaks. • wear a watch. • A goal is workable if it • is challenging. • is inexpensive. • is realistic. • is valuable. • Which statement about when people should stretch is MOST accurate? • It is good to stretch before eating. • Never stretch early in the morning. • It is good to stretch before exercise. • Always stretch before going to bed. Welcome to the Data Warehouse Ambiguous Negative Message HOME HELP Ambiguous Determiners Consistency PROBLEMS
Assessments CREATE TESTS Welcome to the Data Warehouse HOME HELP CREATE TESTS
1, Review Reference Resources Text or subject/content reference Test Specifications Similar tests, pretests, etc. Similar test results 2. Determine Content Cognitive levels Learning Objectives 3. Determine Format/Length Purpose Time 4. Process Questions/Responses Write, Revise, Edit, Proof FCAT Specifications: http://test.ccps/Resources/ResIndex.aspx Welcome to the Data Warehouse HOME HELP CREATE TESTS
Log in to Data Warehouse http://test.ccps Welcome to the Data Warehouse HOME HELP 6/2 last (or first) 4 digits of SS# Mary Jones = Jonesma Login help: Synthia LaFontaine: lafontsy@Collier.k12.fl.us 377-0028 CREATE TESTS
Welcome to the Data Warehouse LEFT VERTICAL MENU Online Test HOME HELP ONLINE TEST MENU Creation/Modification CREATE TESTS
Welcome to the Data Warehouse TEST BANK Create Tests Access Tests YOU Created HOME HELP QUESTION BANK Create Questions Access Thousands of Questions CREATE TESTS
Welcome to the Data Warehouse HOME HELP QUESTION BANK Create NEW Questions ACCESS/USE/EDIT Existing Questions CREATE QUESTIONS