X
Ocotillo Retreat 99
Flagstaff, AZ
May 18-19, 1999
welcome
location
agenda
discuss
photos
evaluation
next steps

This is a summary from the three group report-outs on each issue

go to:
ocotillo central 		Ocotillo.retreat.99 (xyz reports)

Group Reports:
ISSUE:
Assessment of Technology

QUESTION:
What are examples of relatively "easy" to obtain measures of technology use that provide meaningful data that support future planning and institutional goals? These should be things that can be done on a consistent basis.

e.g. inventories of technology, computers-student ratios, percentage of classrooms equipped with technology, hours of availability of computer labs, measures of software usage
What's Important Doable? When? by Whom?
Course specific - Nationally (or District) Standardized Student Survey Course Evaluation Tool (to establish norms) ~10 questions Yes May 2000 Institutional Effectiveness Office
Lesson Evaluations: In-class research to rate effectiveness of technology Yes Ongoing Individual faculty
General College Experience Survey - upon graduation:
  1. Technology expectations met?
  2. Did technology enhance your learning?
  3. Do you feel you have appropriate technology skills to enter the work force and/or to transfer to your next college?
 Yes Graduation 2000 Institutional Effectiveness Office
Incorporate technology/learning assessment into Institution-wide Assessment
  • Student evaluations of technology measures
  • Classroom research
Yes Now Faculty with Assessment specialization

District-wide Assessment specialist
Longitudinal Assessment
  • Incoming vs. end of program (degree)
  • Beyond leaving programs/college
Yes ? Faculty, Post-Grad Assessment
Study how other institutions are using technology vs. learning metrics for best practices and benchmarks Yes Now District-wide resources
Statistically valuable data of students- Qualitative research: Surveys/Questionnaires of students, faculty, employers; classroom research (Pat Cross type); Student focus groups; Student self-assessment Yes Ongoing Colleges
Qualitative research: Standard tests/measures; technology is independent variables; pre/post tests; control groups Yes Ongoing Colleges
Instructional Design: Technology is the tool; learning styles; consult with content experts Yes Ongoing Colleges
Other Benefits of Technology: Cost effective, time better utilized; more interesting; safer; environmental benefits Yes Ongoing Colleges

DISCUSSIONS:

  • National or district standardized course evaluation; set of questions, approximately 5-10 questions (similar to course evaluations that students fill out toward end of class); by May of 2000; Institutional Effectiveness Office
  • Survey upon graduation; were your technology expectations met? did technology enhance your learning? do you feel you have appropriate technology skills to enhance your work in the world? Graduation of 2000; Institutional Effectiveness Office
  • Lesson evaluations in the classrooms to rate; done in classroom; done by regular faculty
  • National standardized course evaluation
  • Research activity to study other institutions how theyÕre using or comparing technology; to try and get some best practices or get some benchmarks
  • Statistically valuable data of students, faculty, employers; student focus groups, etc.
  • Quantitative data gathered
  • Analysis and assessment with instructional design with technology as a tool
  • Assessment of other benefits of technology; is it more cost effective to use technology? use of time? environmental benefits? other benefits that are not necessarily teaching and learning related