
This is the last issue of Perspectives for the 2007-08 academic year. Please read about the following
RP Group conducts a needs assessment for small and medium size colleges regarding accreditation, research and support services
RP Launches another project with the Hewlett Foundation on recognizing exemplary practices in Basic Skills
Update from Patrick Perry and the CCC System Office
Latest Abstracts of Research from the CCC System Office
A model for identifying Institutional Student Learning Outcomes from College of the Canyons
Read about the upcoming RP Board elections
Check out three Summer Drive In Workshops on GIS, SPSS, and SAS
Finally, please take a minute to give us your feedback on the new format for Perspectives in our online survey: http://www.surveymonkey.com/s.aspx?sm=vHEfTtWf2P_2fFLA_2boW2LpuA_3d_3d
Kathy Booth, Executive Director
On May 1, the RP Group convened a meeting of college presidents and the Chancellors Office to discuss research capacity issues that contribute to accreditation concerns. Currently, sixteen colleges--ranging from small to medium size--are on the accreditation watch list. There are four central issues cited in these warnings: planning & budgeting, program review, student learning outcomes, and governance. Meeting participants shared their concerns and outlined related issues, including:
Lack of capacity to gather critical information and analyze trends that could be used for decisionmaking in areas such as educational programming, staffing, and budgeting
Staffing – having no trained researchers, not enough researchers, or under-qualified researchers
Technology and tracking systems – not having integrated reporting and data enterprise systems, lack of systems to track student learning outcomes
Lack of models for successful links between planning and budgeting
The RP Group, working together with interested colleges and the System Office, hopes to help address some of these concerns. Participants in the teleconference highlighted the types of resources that would help them access and utilize data, including standardized data structures for basic metrics, models of how to compile and use existing data to meet reporting needs, and best practices in areas such as program review, budgeting processes, and enrollment management. Several participants also noted that this is not simply an issue of organizing information; colleges need to put in place the skills, personnel, and mechanisms to do data-driven planning, assessment, and research.
To help determine the best course of action, the RP Group will send a needs assessment survey to capture information about specific concerns and desired resources. Based on responses, RP will create a report and host a second conversation surrounding a proposal on how to proceed, if there is a clear case to go forward. If you would like your college to participate in this needs assessment, please contact Kathy Booth at KBooth@rpgroup.org.
Linda Umbdenstock, Recognition of Promise Executive Director
Basic skills are at the very heart of the community college mandate, and are among its greatest challenges. Across the state and nation-wide, educators and policy makers are focusing unprecedented attention on understanding how diverse populations can make significant advances in basic skills.
The Hewlett Recognition of Promise Program is dedicated to this issue. Starting in fall 2008, the program will recognize a select number of colleges annually that are demonstrating success with basic skills populations through strategies that support systematic improvement. The program will seek out those to recognize rather than ask for applications.
The program is funded by the William and Flora Hewlett Foundation and is administered by the Research and Planning Group of the California Community Colleges. A distinguished group of educational leaders has drawn up the criteria for recognition. Another group of practitioners will visit candidate colleges and bring back recommendations. The goal of the Hewlett Recognition of Promise Program is to increase the visibility of institutional efforts promoting student success and to highlight successful strategies and practices, providing tangible models for all community colleges. The expected outcomes of the recognition program include:
An increased level of awareness of standards for and effective practices in advancing student success in basic skills and, specifically, an increased use of outcomes data to measure success for underachieving student populations.
Increased collaboration among colleges and faculties on issues of equity and success via their basic skills strategies and a greater institutional commitment to basic skills programs.
Increased awareness among policy makers of the practical costs and benefits of successful basic skills strategies in the California Community Colleges.
Policy makers will understand the impact of these strategies on the state, and especially on transitioning populations (first in family to college, English as a second language, under-represented, under-prepared for college, and lower socio-economic groups). With increased awareness, we expect a firm and long-term commitment of resources to the system’s basic skills initiative. For further information, contact: Linda Umbdenstock, Ph.D., Executive Director, Hewlett Recognition of Promise Program at lumbdenstock@mac.com.
Vice Chancellor Patrick Perry (CCCCO System Office)
MIS: Myrna Huffman and the MIS unit will present “Data Impact 2008” at a series of statewide workshops for the colleges and districts over the summer. Workshops are designed to take participants to the next level —how MIS data becomes MIS information. There will be workshops on six separate topics. One workshop will be hands-on (Making the Referential Files Work For You), one workshop will be a webinar (Submitting and Reviewing Employee Data) and the remaining four workshops (FTES, data submission, CTE/Perkins, and curriculum) will be presented three times each (north, central, south). For the convenience and potential cost savings of the participants, the workshop locations were selected based upon proximity to Amtrak, regional transit lines or airports. Contact Debbie Gutierrez at dgutierrez@cccco.edu for the schedule and more information.
The Research and Planning unit followed up its release of the final 2008 ARCC Report (Focus On Results) with the creation of a Customized Edition of the ARCC Report. The Customized Edition will reduce the full report to a much smaller version that provides only the details about the system-level performance and the performance of one particular college. This custom report will be unique for each community college. The Research & Planning Unit also continues its development of two supplementary reports that legislation recently mandated. One is the report on Enhanced Noncredit and the other is the report on the Basic Skills Initiative. Watch for news of these reports sent to the ARCC contacts and RP listserve.
On another front, a proposed analysis for noncredit course repetition continues to move forward. Catharine Liddicoat and Willard Hom of the Research & Planning Unit will present a workshop on data for accountability at an upcoming conference for noncredit officials from the community colleges. The May 08 conference will occur at the Chancellor’s Office. In April, Alice van Ommeren and Willard Hom attended the annual Institute on Applied Research & Statistics (hosted by the Sacramento Statistical Association). The duo presented a cluster analysis of colleges to facilitate peer comparisons for transfer evaluation. An article on best practices for analysis will appear in the Spring issue of the i-Journal.
Technology and Telecommunications: Elluminate has given Catherine McKenzie and the CCC Confer project a “Center of Excellence” Award for 2008, http://www.elluminate.com/community/best_in_class_2008/ccc_confer.jsp. Catherine McKenzie, Blaine Morrow (CCC Confer Project Director) and Michelle Taramasco (CCC Confer Client Services Manager) will be presenting the project nationally through a webinar, “From Unknown to Essential, the CCC Confer Project” on May 22, 2008 at 8:00 am (PST).
The Telecommunications and Technology Advisory Committee (TTAC) will be holding its annual retreat at Kellogg West, CSU Pomona in early May. They will focus on the Technology III Plan and the Value of Investment Model that a workgroup has begun to develop. In mid-May, the Systemwide Architecture Committee will hold their retreat in Sacramento to focus on the technical aspects of the Tech III Plan. Following input from these groups, the Tech III Plan’s Initiative Section will be updated and possibly re-prioritized. This updated Tech III Plan is due July 1, 2008.
Other Issues: Vice Chancellor Patrick Perry has been attending a series of IPEDS Technical Review Panels in Washington DC, representing CCC and community college interests in potential changes to IPEDS data collections. Areas that have been discussed include adding an IPEDS collection for noncredit activities, special collections for distance ed activities, and changes to the graduation rate survey (GRS). MIS has already had to make some changes to the GRS methodology due to the requirement that GRS cohorts should match cohorts created for the annual IPEDS EF (fall enrollment) survey; as such, many of you have noticed changes in Student Right-To-Know Rates. Previously, we were able to use a methodology of determining “first-time, full-time, degree-seeking” in a manner similar to the Student Progress and Achievement (SPAR) Rate (degree-seeking defined behaviorally), but in order to match the IPEDS-EF methodology, degree-seeking can only be determined in the first term of enrollment.
IPEDS will also be driving changes to the collection of race/ethnicity for the system’s collective MIS systems, along with CCCApply. The new format has yet to be finalized, but will merge the Federally-required two question format with State requirements for various ethnic subcategories. New output reporting will also have to be coded for MIS data, and a new “derived ethnicity” data element will likely be created based on Federal counting and trumping rules. Guidelines for this will likely be out by the Summer.
We have also been closely tracking two bills related to data and accountability efforts in California. SB 1298 (Simitian and Steinberg) would create an appointed Statewide Education Data Governing Board, whose task will be to determine the best way to create a longitudinal K-20 education database. SB 325 (Scott) will create an accountability reporting framework for all segments of higher education to serve as a dashboard of progress in how higher education is meeting educational and economic goals of the State. To date, the CCCCO has been active in providing input on both bills to reduce burden and redundancy of existing data collections and accountability efforts; both bills have a great deal of support and inertia and will likely pass in some form this session.
By Willard Hom and LeAnn Fong-Batkin (CCCCO System Office)
The System Office abstracts education articles from a variety of journals and publications. Our abstracts are a valuable reference tool that you can use for no charge. The abstract website covers four main subjects: Research Methods, Strategic Planning, Student Learning/Participation, Teaching and Faculty, and Workforce Development. As before, we encourage researchers and planners to use these abstracts, or excerpts from them, to help inform people of topics that have local relevance. Just credit us as the source when you circulate our material. To browse the complete set of abstracts, just go to abstracts of research under Links on the left side of the Research and Planning Unit webpage:
For the reader’s convenience, we have listed below the titles of the most recent abstracts that my unit has produced.
Research Methods
A Census Revolution: The American Community Survey
Classifying Perfectionist Students
Student Learning/Participation
An Evaluation of California Community College Financial Aid Offices
Workforce Development
National Labor Force Trends: A Federal Reserve Bank Report
Noncredit Workforce Education: State Policies and Community College Practices
Our project this spring/summer will be to develop a searchable index of our abstracts.Today’s education climate places a great emphasis on accountability. We are currently faced with many efforts to publicly evaluate the degree to which our students are successful, including Student Right to Know (SRTK), Accountability Report for Community Colleges (ARCC), the Basic Skills Initiative, Student Equity Plan, and student learning outcomes embedded in accreditation. If these systems are to be useful in not only reporting to the public, but also driving efforts to improve student success, they need to be interconnected and connected to what’s happening in classrooms and with support services. This is further complicated by the fact that our students come to us for a variety of reasons. Nevertheless, institutional student learning outcomes especially hold promise in unifying our efforts, bridging mission statements, large-scale accountability systems, program evaluations, and reviews of success in courses. In this article, I offer a possible model for making these critical connections.
Our mission is not a unified one. We are charged with providing lower-division education and workforce training to students with a variety of goals, interests, and levels of preparedness. As a result, our accountability efforts should reflect this diversity of educational goals. At the broadest level, we should assess the degree to which our students are attaining their goals, including degree completion, transfer, certificate completion, developing specific job skills, personal development, (non-credit) ESL skills, and building developmental skills, to name just a few.
The various accountability systems often measure the degree to which students attain these goals. I refer to these measures as institutional outcomes. While each college will need to determine which specific set of measures to adopt from the various accountability systems, I argue that some measure of each of our students’ educational goals should be used. For example, institutional outcomes could include measures of the following: Transfer rate, Degree completion rate, Certificate completion rate, Specific job skills development rate, Degree of personal development attained, ESL skill development rate, and Rate of transition from developmental skills to degree applicable curricula. While specific measures of institutional outcomes will be more or less salient from college to college, collecting data on some measures and publically reporting the results is a responsibility we owe to our communities. Furthermore, as we decide which measure to include, we should avoid excluding large groups of our students, such as part-time students or underprepared students, from the set of measures.
For each of the institutional outcomes, colleges can develop measures of institutional student learning outcomes (ISLOs). Yes, I’m arguing that we should not develop a single set of ISLOs for all students. Rather, that ISLOs should be connected to the students’ educational goal and respective institutional outcomes. Furthermore, we already have meaningful structures in place for determining many of these ISLOs in IGETC and CSUGE requirements. We have found that using these structures in defining the ISLOs is very useful. Therefore, specific ISLOs could be developed for each of the following: Transfer and degree completion, English Communication, Mathematical Concepts, Arts and Humanities, Social and Behavioral Sciences, Physical and Biological Sciences, Languages other than English, Lifelong Understanding and Self-development, Certificate completion, Specific job skills development, Personal development, ESL skill development, and Developmental skills.
One promising approach to development of these ISLOs is to bring groups of faculty together to define and measure the ISLOs and use the resulting data to make improvements. As we call these groups of faculty together, it is especially important to ensure that they have a clear understanding of SLOs for their specific courses and programs related to their ISLO. For example, faculty working on ISLOs for English Communication should be those who teach the courses that satisfy this requirement and are already familiar with the SLOs for the respective course and programs. As a group, they can have a conversation about their individual course SLOs, program SLOs, and proposed ISLOs. This conversation can ensure that there is a strong connection between the SLOs at the various levels and that the efforts to make improvements are well connected and complementary.
As data are evaluated for each of the levels, we are better prepared to ensure that efforts to improve student success for courses is well connected to efforts to improve success in programs, efforts to improve ISLOs, and ultimately, efforts to improve on measures of institutional outcomes. Of course, these evaluative processes will certainly be dynamic and new programs and accountability systems will continually emerge. Placing great emphasis on dialog and improving our programs and services will serve us well, even in the face of ever changing systems.
Be on the lookout for a letter that includes a ballot for RP board members and invoices for RP institutional memberships. This letter was mailed to the contact person associated with each college or district office that supports the institutional research function.
RP's memberships cover all individuals associated with member colleges/districts and provide access to discounted registration at RP events and a complementary subscription to the Journal of Applied Research in the Community College. At just $350/year, we strive to keep membership affordable while generating resources that pay for services such as Drive In Workshops, Regional Consortia, and conference presentations on research, planning, and assessment issues. We sent out the dues reminder earlier than usual this year to give our members the opportunity to pay during the current fiscal year.
We have a great pool of potential RP board members on the ballot this year including:
- Craig Hayward, Ph.D., Director of Planning, Research and Knowledge Systems, Cabrillo College
- Catherine A. Jackson, Ph.D., Director of Research and Planning, Shasta College
- Bayinaah Jones, Ph.D., Executive Dir. Research & Institutional Effectiveness San José/Evergreen Community College District
- Alice van Ommeren, Research Program Specialist, California Community Colleges Chancellor’s Office
- Veronica Lynne Van Ry, Research Technician, College of the Sequoias
- Dr.Matt Wetstein, Interim Dean of Planning, Research & Regional Education, San Joaquin Delta College
- Frances Wu-Barone, Ph.D., Senior Research Planning Analyst, Pasadena City College
If you'd like to read statements by the candidates, as well as the proposed executive committee slate, it is available on the RP website at: http://www.rpgroup.org/documents/RPCandidates2008.doc
Kathy Booth, RP Group Executive Director
As part of our mission to provide professional development, RP will be offering three workshops this summer.
Student & Demographic Analysis Using GIS Mapping
June 9-13, Rio Hondo College in Whittier, $100
If you are looking for an in-depth opportunity to learn how to do student and demographic analysis using GIS mapping, you should sign up for RP’s week-long bootcamp. This four credit course includes a face-to-face segment, a follow-up online component, and a one year software license for ArcGIS. Working with data from your own college you will learn how to obtain, spatially display, and query elements such as community demographics, political geography, student population, addresses, and college services.
SPSS 15.0 Tips, Tools, and Tricks for Beginning to Intermediate Users - Northern Workshop
June 27, Laney College in Oakland, $50
Our SPSS workshop was so popular in the South that we decided to hold one in the Bay Area as well. Offering time saving tips gleaned by a California community college researcher, this workshop is a great opportunity to get familiar with SPSS or brush up on your skills. Topics include: split files, custom tables, computing variables, automatic recode, the Identify Duplicate Cases command, merging files, creating large syntax files for recurring projects, the aggregate command for tracking purposes, and how to calculate effect size in Excel from the Independent Samples t-Test Output.
SAS 9.0 - Using SAS to Create Data Flow
July 28, City College of San Francisco, $50
One of the most important objectives of a Research Office is to flow data to decision makers. To this end, processes can be set up to pull data automatically from a production database, route it through a computer, and export it to either an email or website. This workshop will demonstrate this process by using a Banner database, implementing SAS as the control program, utilizing Windows XP as a virtual server to send emails, and creating Excel files that can be uploaded to a website.
To register or for more information about these sessions, visit http://www.rpgroup.org/events/workshops.html
Also, as part of our strategic planning process, RP will be developing a yearly professional development plan targeting key issues for research, planning and assessment staff, faculty, and administrators. If you have thoughts about topics or the types of opportunities that would help you succeed, please email them to KBooth@rpgroup.org.
500........ Number of administrators, faculty, and staff who attended the sold-out 2007 Student Success Conference
72.......... Number of researchers who attended the 2008 RP/CISOA Conference
126........ Number of attendees at RP/Academic Senate SLO training this academic year
23.......... Number attendees in RP Summer Institute on Research Basic Practices 2007
85.......... Number of researchers who attend our 13 regional consortia this academic year
524........ Number of people on the RP Listserv (see http://www.rpgroup.org/membership/listserv.html)
1,235..... Number of people on the Assessment Listserv
12.......... Number of research, planning, and technical application awards given by RP
7............ Number of current research projects by RP and the Center for Student Success
