Promotion and Tenure Metrics for New Media-- 2009
Abstract:
Despite the transformation in information technologies, few universities have revised performance expectations and promotion criteria. These changes have had a profound impact on outreach and extension staff. The purpose of this session is to outline expectations for extension professionals (county, regional and state) and to define the metrics to assess these activities.
The basic expectation is that personnel will create unique information technology-based instructional material that address issues confronting individuals, organizations and/or society using knowledge based on scientific research. Generally, staff will be expected to develop instructional material for both the general public and professionals. Two broad types of information technology instructional strategies are expected to be developed—a broadcast strategy (one to many) and an engagement strategy (many to many). Broadcast strategies are designed to reach a broad group of people and might include such tools as an email newsletter, instructional video, or podcast. Engagement strategies are designed to foster extended learning communities and might include technology tools such as blogs, games, online courses, etc.
A standard set of metrics will be used to assess the quantity and quality of the information technology- based broadcast and engagement activities. Three general types of outcomes will be assessed—levels of participation, client satisfaction and participant change. For example, to measure the quantity of participation, page views and unique visitors will be recorded. Measuring the quality of broadcast strategies would include links and citations. Metrics for assessing participation within engagement strategies would include the number of people involved, the length of time people are engaged, and/or participant contributions.
Standard tools and indices will be used to routinely assess satisfaction, although quantitative measures such as repeat users, depth and length of time on a website, blog, or game can serve as a proxy for “satisfaction.” Metrics and strategies for assessing outcomes will have to be tailored to the types of changes sought in regard to the programs, but general procedures will be outlined that can be incorporated into broadcast and engagement approaches.
other reference material: http://open2learn.blogspot.com/2009/10/references-notes-guidelines-for.html
1 comment:
Very interesting presentation! I'd encourage you to also look at additional tools for measurement, such as ROI and enrollment numbers. Check out http://smroi.net for more info on ROI. I'd love to talk about this more if you are interested. You can find me on twitter @carakeithley.
Post a Comment