2014-2015 QA Analysis Training

1. 2014-2015 QA Analysis Training David Rhodes and Holly Langer-Evans

2. Analysis Preparation

3. The Process

4. Uploading Process • One flat file to upload ISIR Records and Verification Criteria • Upload Capacity 3,000 records

5. Prepare Flat File of Verified Records • SSN • First two letters of the last name (CAPS) • Initial Transaction • Paid-On Transaction • Include a “Y” if records met your school criteria • School criteria code(s) record met Field Length: Up to 56 characters

6. School 1: School Criteria

7. School Criteria

8. Question to Answer

9. Access Report Run Report Pell Grant Improper Payment Report

10. Right click on report Select New Select Report Pell Grant Improper Payment Report

11. Pell Grant Improper Payment Report • Access Report-Select OK-Select Run Icon

12. Pell Improper Payment Report • Open your Pell Improper Payment Reportto begin your Analysis • How to save report depends on your browser ISIR Categories Grey Ribbon Bar

13. Internet Explorer Browser

14. Saving using Firefox

15. Chrome Browser

16. From the Ribbon Bar, locate Selected _By_CPS and select the down arrow From the Menu, select Roll Up, and then Selected_By_CPS Create A Roll Up Table

17. 546 records not selectedby CPS 1306 records selected by the CPSAdd a category to the table: Institutional Verification Criteria What is the Report telling you?

18. Select the icon Click on Chart/Rollup Tool select, INST_VERIF_CRIT and drag it into the Group By columnHint: Drop it in the Group by column when you see the red line Select OK Add a field to the Roll up Table ___________

19. What is our Focus? Displays as a bar chart. To change to a cross tabulation select • records without codes • records not selected by CPS that were selected by the school • selected by both CPS and School

20. Filter on the 546 Records • Go to Gray Ribbon at the top of the original Report we ran andselect the down arrow onSelected_By_CPS, SelectFilter and select equals, Scroll back to report • Next to equals box select downarrow and select NO • Select Add Condition Box, Selectthe Select_By_School Field, SelectEquals, Select down arrow and selectYes • Select Filter

21. What Does this Report Tell Us? • Identifies records not verified by the CPS but were verified by the school. Identified the verification groupings • It doesn’t tell us the impact the verification groups had on Pell or EFC

22. Add ABS Pell and ABS EFC • Select the iconClick ADD (Y) select,ABS_EFC_Change • Select the iconClick ADD (Y) select,ABS_PELL_Change • Select the icon and change it to SUM

23. Roll Up: Report: Cumulativeeffect on EFC and Pell Display report as Cross Tabulation Select SUM to obtain cumulative dollartotals for ABS EFC and ABS Pell Change.

24. Average effect on Pell and EFC Caution: this ICON will not display a visual change when you select SUM, AVG or Count Select AVG to obtain the AVG change to ABS PELL and ABS EFC

25. How to Customize Results Can move pane by clicking on blue bar and dragging it to the side or up or down. Use Icon to add Categories Change count to sum or AVG Use down arrow to select ascending or descending order Ribbon Bar –Gray Box Change count to sum or AVG Displays report as a bar graph This displays a cross tabulation Drag corner to make report larger

26. Narrow the Search: Group by X • Select the icon • Select • Select

27. Narrow the Search: Group by X • Criteria C – Average ABS EFC and AVG PellGroup X:Filing Status

28. Revised Criteria • Married parents where total parent AGI is > than $47,000, whose EFC is $6000 or less and whose untaxed income is zero or blank and NOT selected by the CPS, Will File

29. Live Demonstration

30. School 2: School criteria

31. Analysis: Cross Tabulation • Sum of ABS EFC & ABS PELL

32. Analysis: • Average change of ABS Pell and ABS EFC • Let’s take a further look at Criteria 91V215

33. Narrow your Search: Group by X • Criteria 215 – Average ABS EFC and AVG PellGroup X: PAGI CategoryNote PAGI Category 50,000 and higher

34. Revised Criteria • Pell eligible Dependent Students whose parent's AGI >$50,000; filed 1040; not eligible for 1040A/EZ; no auto zero EFC flag; not a dislocated worker; and NOT selected by CPS

35. School 3: School criteria

36. School #3 • School verification very similar to CPS verification • Let’s look at the 30 records

37. Cross Tabulation Results

38. Analyze: Selected by CPS and by School • AVG ABS Pell and EFC Change by descending order • What does this tell us?

39. Narrow your Search: Group by X DV14 Criteria: Dependent, Pell eligible, No Pell Grant eligibility for 12/13 – Newly Pell eligible

40. Revised Criteria Dependent, Pell eligible, No Pell Grant eligibility for 12/13 AND PARAGI >=35,000 and Selected by CPS

41. School #4 • There are 32 school criteria • You can download the criteria from the webinar download center • Which criteria make a significant impact on EFC/Pell? • Which criteria would you eliminate or modify?

42. Analysis • Display Pell Change in Descending Order

43. Analysis

44. Narrow your Search: Group by X VFAGG Criteria: Parent # of family members equals blank, zero, 1 or 2 and parent marital status = married and both parents living together. Group X by filing status and PARAGI Average ABS Pell and EFC Changes

45. Revised Criteria • Parent # of family members equals blank, zero, 1 or 2 and parent marital status = married and both parents living together, Not Selected by the CPS AND Parent AGI > = 50,000

46. Analysis Assignment • Open the Pell Grant Improper Payment Report • Create a Roll-Up-Table • Use the Group X feature to further analyze data • Determine which school criteria would add the most to CPS verification and how you might need to “tweak” your school criteria to maximize its return on investment as an add on to federal verification • Know and have the definitions of your school criteria in mind when interpreting your results

47. Analysis Preparation

48. Resource • QA Web Site- Training and Guidance Linkhttp://ifap.ed.gov/qadocs/ToolsforSchools/2012QASession1.pdf

49. Regional Representatives • Holly Langer-Evans • Phone:617 289 0136 • Email: Holly.Langer-Evans@ed.gov • Michael Cagle • Phone: 206-615-2586 • EMAIL: Michael.Cagle@ed.govAnne Tuccillo • Phone: 202-377-4378 • Email: Anne.Tuccillo@ed.gov