1 / 26

Citizens of Influence: An Instrument Design Project

Citizens of Influence: An Instrument Design Project. Mandalyn Swanson, M.S. Robin Anderson, Psy . D. Agenda. Introduction Purpose of Study Method Results Conclusions/Interpretations. Introduction. Kijiji : Basic Overview Relatively New Social Change Model of Leadership Development

sabina
Download Presentation

Citizens of Influence: An Instrument Design Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Citizens of Influence: An Instrument Design Project Mandalyn Swanson, M.S. Robin Anderson, Psy. D.

  2. Agenda • Introduction • Purpose of Study • Method • Results • Conclusions/Interpretations

  3. Introduction Kijiji: Basic Overview • Relatively New • Social Change Model of Leadership Development • Transforms students to be “Citizens of Influence” • Leadership • Social Change • Change Action Projects • Semester Commitment

  4. Goals of the Social Change Model 2 Primary Goals:

  5. The 7 C’s Societal/Community Values Individual Values Group Values

  6. Kijiji: Citizen of Influence A Citizen of Influence does EIGHT things: Knows their passion. Acts on their passion Joins with others who share their passion Connects and develops relationships with others who share their passion Actively participates with other in acting on their passion together Includes other stakeholders in the process of developing solutions for specific community problems related to their passion. Actively engages, are/or recruits others to participate with them in making a change in society that is connected to their passion. Learns from experience to continue to grow, expand and develop their passion

  7. Establishing Objectives Selecting/ Designing Instruments Using Information Continuous Cycle Collecting Information Analyzing/ Maintaining Information The Assessment Cycle

  8. Designing an Instrument Purpose of Study: Measure Program Objectives Know the theory Relate theory to objectives Match objectives with possible measures/items Create/design instrument Pilot instrument Perform an item analysis Use results to tweak instrument

  9. The Instrument • Original Scale • College Students’ Experiences of Their Classes Survey (SOB): 89 items • T.M. Freeman and L.H. Anderman(2003) • 5-point Likert scale • Not at all true of me – Completely true of me • 4 open-ended questions • Four Scales:1 • Social Acceptance (=.82) • Professors’ Pedagogical Caring (=.75) • University Belonging (=.72) • Class Belonging (=.90) 1T.M. Freeman, personal communication.

  10. The Instrument • Revised Scale • College Students’ Experiences of Their Classes Survey (SOB): 14 items • Used first 18 items – University Level Measures • 3 Factor Model (Social Acceptance, Professor Caring, University Belonging) • Eliminated 5 items (Professor Caring) • Edited remaining 9 items • Added 1 item • Links to: CoI 4

  11. The Instrument Examples: 3. It is hard for people like me to be accepted here. 3. It is hard for people like me to be accepted in Kijiji. 7. There is at least one professor or other adultin the universityI can talk to if I have a problem. 7. There is at least one person in KijijiI can talk to if I have a problem.

  12. The Instrument • Civic Responsibility Behavior Questionnaire (CR): 41 items • R. Markleand colleagues(2008) • 5-point Likert scale • Items 1-25: Never or Rarely to Frequently • Items 26-41: Strongly Disagree to Strongly Agree • Six Subscales:2 • Civil Behavior (=.78) • Political Behavior (=.80) • Social Behavior (=.83) • Civic Efficacy (=.84) • Civic Motivation (=.91) • Values • 2R. Markle, personal communication, June 27, 2009.

  13. The Instrument • Civic Responsibility Behavior Questionnaire (CR): 22 items • Used first 25 items • Civil Behavior • Political Behavior • Social Behavior • Modified 12 items • Created 13 new items • 5-point Likert scale • Not at all true of me – Completely true of me • Links to: CoI 2, 5, 6, 7

  14. The Instrument Examples: 3. I consult television for political information. 3. I watch television program covering my area of passion. 7. When I act, it is important that I address the cause of the issue.

  15. Method • Item Analysis • Changed item wording/added new items • Assesses the quality of a pool of items • Precursor to reliability and validity studies • For this instrument: • Analyzed each scale separately • Collected data: Qualtrics • N = 40

  16. Results Frequency Distributions 3. It is hard for people like me to be accepted in Kijiji. 3. I watch television programs covering my area of passion.

  17. Means & SD

  18. Inter-Item Correlations • Magnitude of correlations varied • SOB: .001 to .753 • CR: -.008 to .836 (generally low) • Problematic Results: • SOB: • Item 3: low correlations- some negative (.001 to .345) • CR: • Item 3: very low, negative correlations (-.008 to .386) • Item 4: (.039 to .613 )

  19. SOB

  20. CR

  21. Corrected Item-Total Correlations

  22. Inter-Item Consistency (Reliability)

  23. Quick Notes • Sample Size: • Can be unstable if sample size is inadequate • High correlations |.6-.7|: 100 minimum • Otherwise, 300 minimum • Deletion of Items: • Not based on IA alone • Content representativeness • Timing of Administration

  24. Interpretations/Conclusions • Limitation: Small sample size • Item 3 (on both scales) is clearly problematic. • Item 3 on CR was problematic1 • Combine multiple semesters • Factor Analysis with modified items • 2R. Markle, personal communication, June 27, 2009.

  25. References Dugan, J.P. & Komives, S.R. (2007). Developing leadership capacity in college students: Findings from a national study. A Report from the Multi-Institutional Study of Leadership. College Park, MD: National Clearinghouse for Leadership Programs. Freeman, T. M. & Anderman, L. H. (2003, April). Professor caring and social acceptance as predictors of college freshmen’s sense of university belonging. Paper presented at the annual conference of the American Educational Research Association. Chicago, Il. Freeman, T. M., Anderman, L. H., & Jensen, J. M. (2007). Sense of belonging in college freshmen at the classroom and campus levels. Journal of Experimental Education, 75, 203 – 220. Higher Education Research Institute. (1996). A Social Change Model of Leadership Development Guidebook (Version III ed.). Los Angeles, CA: Higher Education Research Institute, UCLA. Komives, S. R., Wagner, W., & Associates, a. (2009). Leadership for a Better World: Understanding the Social Change Model of Leadership Development. San Francisco, CA: Jossey-Bass. Wagner, W. (2006). The Social Change Model of Leadership: A Brief Overview. Concepts & Connections: A Publication for Leadership Educators, 15 (1), 8-10.

  26. Questions?

More Related