Step 3: Analyze the Data

 Download instructions. 

STEP 3:  ANALYZE THE DATA (Each SP and FA Term)

Review the data every semester and submit a data analysis report.

Review the data carefully and identify key trends.  What changes will you make to help students achieve the stated program outcome?  Your analysis should include how you will use these results to improve or enhance the program's activities.  Be prepared to assess how you did at the end of the year (See Step 4:  Annual Closing the Loop instructions).   

1. Use the Report Manager to view reports. 

You must be on campus to access these reports.  Click on the Planning and Assessment directory folder and use the following reports to assess your program or course. 

• Assignment Grade Distribution
• Data Collection Summary
• Grade Summary
• Program Assessment Plan
• Student Attainment of Learning Outcomes 

     A.  Assess the data collection process

     Because we have a new database and are trying to automate data entry and reporting, it is important to assess the data collection process.  Review the Data Collection Summary report and identify ways to improve the data collection process.

• Select the term SPRING 2011 from the Year/Term drop down menu (do not select any other parameters)
• Review the summary report which gives you the percentage of data turned in and then the list of submitted or not submitted data by section.
• Analyze the data
  • Is there a sufficient amount of data?  Why or why not?
  • Are adjuncts turning in data?  Why or why not?
  • Did you encounter any specific issues with data collection? 

     B.  Are the assessment tools appropriate?

     Sometimes the assignment or rubric is not accurately assessing the competency. Review the Assignment Grade Distribution reports and determine whether the data indicates that there may be a problem or disconnect with either the assignment or rubric.    

• Select the program from the drop down list to view all courses being assessed within a particular program.
• Select a single or multiple course(s) by entering the course code (Example:  ENG101)

     C.  Assess the entire competency for the term - what can be improved?

     Conduct a data analysis using the statistics provided in the Assignment Grade Distribution for all of the courses under this competency/program outcome.

• Identify any discrepancies and email Marc Roy to make corrections.
• What is the average level of performance for the class?  Use the mean, median, mode to look at averages.
• What is the level of variability in the scores?  Is there a high level of variation in the scores?  Use the range, variance, or standard deviation.    

Analyze and synthesize the term data, and discuss your observations with your colleagues.  Note your observations, particularly if anything surprises you or is unsettling about the data.   

2. Write a Summary Report

Document your recommendations for instructional, programmatic, or institutional changes that would improve student outcomes. 

•  Develop a short narrative that combines A (data collection), B (assessment tools), C (data analysis) at the competency level.  Include all assignments for that competency into one paragraph so that it can be easily digested. 
• Make sure your analysis is clearly distinguished between general education and program level.

Enter your report into the 2010-2012 Stud Learn Data spreadsheet located at:    U:\Institutional Effectiveness\2010 IEP\2-Student Learning(Access may be limited)