Form 201BC: Assessment Report Form for Instructional Programs

Prepared by: Maryse Nazon

 

Department: Psychology/AODA Certification Program – Post-baccalaureate

 

Student Learning Outcomes

As part of assessment, the Psychology Department/AODA Certification Program has generated seven specific program outcomes:

 

  • Students will learn to define and recognize the actions of psychoactive drugs as they affect the body; recognize and know the signs and symptoms associated with the different classifications of psychoactive chemicals.

 

  • Students will know the principles and processes of human physical, mental, emotional, spiritual and social development including basic abnormal psychology and effects of chemical usage on growth and development and more specifically women and adolescents.

 

  • Students will know the historical development of alcohol and other drug abuse treatment including the history of chemical usage in the United States, development of the various treatment modalities and its relationship to the community at large.

 

  • Students will know the eligibility requirements and criteria for specific delivery models of service; know what services are offered in each modality with applicable regulations and limits of each; know when it is appropriate to make referrals to Outpatient, Detoxification, Residential, and Self-Help Groups.

 

  • Students will have a practical knowledge of applicable Illinois and Federal laws in particular rules and regulations governing but not limited to: intake protocol, discharge requirements, confidentiality regulations, record keeping, child abuse reporting act, and client and provider rights.

 

  • Students will learn the core functions of an alcohol and other drug abuse counselor; apply the unique knowledge and skill base in the execution of Core Functions in an AODA treatment setting.

 

  • Students will know the requirements of IAODAPCA AODA Counselor Code of Ethics, and be able to apply this Code of Ethics to the Core Functions. 

 

Methods of Assessment

This assessment report for the Post-Baccalaureate AODA Program Assessment Plan covers the following period: Fall 2011 and Spring 2012. Following are listed and explained the methods of assessment (see the Assessment for how the measures match learning outcomes).

 

INSTRUMENT: PSYC 5205 Assessment InstrumentIn order to receive a grade of “Pass”, students should score 70 or better over 100 possible points on the Midterm and Final exams for PSYC 5205.  Both scores for each student will be added and averaged.  Students who do not do so will be advised to take appropriate courses to increase their score by the time they undergo the Comprehensive Assessment instrument. This assessment measures outcomes #1, 2.

 

INSTRUMENT: Comprehensive Assessment Instrument In order to receive a grade of “Pass”, students should score 70 or better over 100 possible points on the Comprehensive Assessment Instrument.  It includes questions from the PSYC 5205 Assessment Instrument plus other questions reflecting the content objectives of the AODA Certification Program. This assessment measures outcomes #1, 2, 3, 4, 5, 6, 7.

INSTRUMENTS: Twelve Core Functions, Case Assessment & Treatment Plan, Written Case Study, Referral Folder -For the term paper, a grade of 70+ must be earned.  The assignments are measured as follows:

 

  • Twelve Core Functions Paper: In order to receive a grade of “Pass”, students should score 70 % or better (35/50 = 70 %). This assessment measures outcomes # 6.
  • Case Assessment & Treatment Plan: In order to receive a grade of “Pass”, students should score 70 % or better (70/100 = 70 %). This assessment measures outcomes # 1, 2, 4, 5.
  • Written Case Study: In order to receive a grade of “Pass”, students should score 70 % or better (70/100 = 70 %). This assessment measures outcomes # 5, 7.
  • Referral Folder: In order to receive a grade of “Pass”, students should score 70 % or better (35/50 = 70 %). This assessment measures outcomes # 4.

 

These papers demonstrate student’s use of research and study skills.  The papers demonstrate knowledge of AODA processes, skills and services best suited to the individual client’s needs.  The papers also exhibit use of critical thinking skills in evaluating and employing AODA theories and evidence-based practices.  Students are asked to develop a thesis in logical fashion, and clear writing and error-free English prose.

 

INSTRUMENT: Student Field Experience Evaluation Form – At the end of their field experience student will be evaluated by their Field Experience supervisor in the following areas: analytical ability, administration, inter-professional relations, practicum skills, knowledge, and work habits.  The form uses a five level scale: no basis for judgment, below average, above average, and excellent.  An overall rating of above average to excellent is considered a “pass” for this assessment. This assessment measures outcomes # 4, 5, 6, 7.

 

INSTRUMENT: Alumni Survey -Within one year after graduation, the Department will contact you to request information about your experience after completing the program, and in particular, to find out how well your education at Chicago State facilitated success in your subsequent occupation or pursuit of further education, as well as to what degree your education contributed to your success in the professional field. You will be mailed survey instruments designed to measure your level of satisfaction with the AODA certification program feels you were prepared for job success in terms of your academic training and preparation. This assessment measures outcomes # 1, 2, 3, 4, 5, 6, 7.

 

Assessment Findings

Students were tested in Psychology of Drug addiction classes in the Fall of 2011 and Spring 2012.  Fourteen graduate students were enrolled in PSYC 5204 – AODA Internship between the two semesters.  The Comprehensive Assessment measure was not administered since it is being developed at this time.  None of the students currently included in this current assessment had the opportunity to complete PSYC 5205 Assessment Instruments since it became part of the curriculum of that course in Summer 2011 and all the students had already completed that course. Students’ scores for assessment that were not yet completed or were completed at another university were eliminated from that course topic.  The percentage of students passing and average scores are broken down by assessment in the table below.

 

Assessment

N

% Pass

Average Scores

PSYC 5205 Assessment Instrument

Not administered

--

--

Comprehensive Assessment Instrument

Not administered

--

--

Twelve Core Functions Paper

9

100 %

45

Case Assessment & Treatment Plan

14

100 %

91

Alumni Survey

Not administered

--

--

Written Case Study

11

100 %

94

Referral Folder

11

100 %

48

Student Field Experience Evaluation Form

9

100 %

Above Average

 

Indirect Assessment – Alumni Survey:  Although included in the Assessment plan, no Alumni Survey was administered.  They will be given to students in the Fall 2012.

 

Analysis and Program Change

Results from the standardized measure and other assessments show that post-baccalaureate students are performing at a high level.  The number of students who passed the assessments administered with a score of 70% or above was at 100 % in all areas. In addition, students receive high ratings above average to excellent from their Field Experience supervisors.  This indicates that students are gaining the knowledge but also being able to apply their learning in real life situation.

 

Results also indicate the value of administering the Comprehensive Assessment Measure to evaluate the level of preparedness of students who will be taken the state certification exam.  An exit survey is indicated to evaluate student’s evaluation of their own learning and preparedness for the workforce and graduate work.  Results from the Alumni Survey will validate the effectiveness of the program.

 

Decision Making Using Findings

No major changes need to be made at this time.  Some considerations should be given to including more standardized assessment instrument. With the addition of the results of the measures listed above the program will be placed to make recommendations to the department about needed changes.

 

Accomplishments and Challenge

The program appears to provide student with a great learning experience, as well as the assessment of the quality of their learning and experiences.  This assessment plan offered the program the ability to collect data in order to enhance program outcomes. Tracking the impact of specific courses on student’s learning is important for the survival of the AODA program.

 

The only challenge that could be identified at this time is ensuring that various sections of our core courses are covering the similar material.

 

Publicizing Student Learning

All assessment results presented in the report are shared with department faculty, as well as the dean, department chair, and relevant internal stakeholders.  In addition, the AODA Program assessment file will be added to the department file(located in the psychology department office).  We have also added an assessment section to our departmental website.  This section includes information about assessment procedures and results.