Evaluation

The Research Corporation of the University of Hawai‘i (RCUH) intends to enter into an Agreement for Services with a Contractor to provide integrated Grant Evaluation Services for three related National Science Foundation Human Resources Division (HRD) grants to Kapi‘olani Community College, University of Hawai‘i system:

  1. Faculty Integration, Research, and Engagement in Urban Polynesia (I-Cubed) HRD-0833482
  2. Ecological Ahupuaa Monitoring in Urban Polynesia (TCUP) HRD-1023665
  3. Hawaii’s Pre-engineering Education Collaborative (PEEC) HRD-1037827

The I-Cubed grant seeks to institutionalize and measure the STEM program at Kapi‘olani Community College, develop innovative strategies for faculty to support Native Hawaiian and other underrepresented minority students to succeed as pre-STEM majors, and to find innovative solutions to the challenges of broadening the workforce in STEM.

The TCUP grant seeks to increase educational access and success for Native Hawaiian students in biological sciences. The TCUP project will support the transfer of well-trained Native Hawaiian students to the University of Hawai‘i at Manoa where they, too, are underrepresented in the total graduate pool.

The PEEC grant, like the TCUP grant, seeks to increase education access and success for Native Hawaiian students, but in collaboration with five cooperating University of Hawai‘i campuses in engineering fields. Hawaii’s PEEC project will enable its community colleges to transfer more well-trained Native Hawaiian students to the University of Hawai‘i at Manoa College of Engineering where they are significantly underrepresented in the total graduate pool.

The College STEM program, working with a single external evaluator, will benefit from the integrated efforts of the external evaluation of the three grants through an enhanced integrated communication network as well as from further intense work together. The three grants highlight the same overarching goal: applying best practices to support students from our College so that they succeed in STEM fields when they transfer.

To meet grant goals and outcomes, the projects require an external grant evaluator to review and assess how the I-Cubed, TCUP, and the PEEC collaborative are engaged in meeting the goals of the projects. The external evaluator will work in collaboration with the College’s Office for Institutional Effectiveness and should have a demonstrated understanding of the objectives of the National Science Foundation’s I-Cubed, TCUP, and PEEC grant initiatives.

The Contractor will serve as an external evaluator of the grants and will provide regular programmatic evaluation services and reports over the length of the grants based on the grant outcomes and evaluation activities as specified below.

To be eligible to apply, offerors shall have:

  1. A minimum of five years experience in federal grant project evaluation with large federal granting agencies such as the National Science Foundation educational grants.
  2. Expertise in using quantitative and qualitative methodologies in conducting evaluations.
  3. Experience in evaluating student and faculty progress and development.

The rationale for integration of the evaluation services for the three grants follows:

The I-Cubed grant, as part of its charge from NSF, seeks to integrate HRD grants and institutionalize processes and communication structures, so the integration of the three grants with one external evaluator would produce useful material and arguments for College adoption of successful treatments. Due to the parallel nature of TCUP and PEEC activities, such as parallel summer bridge treatments and cohort management, having an external evaluator apply the same evaluation methods to the TCUP and PEEC students would be efficient, interesting in a comparative sense, and would give the College STEM program more coherent material to use in its research and dissemination of the success of the TCUP and PEEC treatments.

The best practices and methodologies in student cohort management that are being implemented in the TCUP and PEEC grants are parallel:

  1. Cohorts of Native Hawaiian students will be supported and tracked over five summers and four intervening years in Biological Science (TCUP) and Physical Science (PEEC).
  2. Each summer experience will emphasize mathematics in the mornings via a math emporium model overseen by our mathematics instructors, and in the afternoons, research and introductions to the breadth and depth of Hawaiian science via biological and physical science faculty.
  3. During the intervening years, before transfer, students are supported by peer mentors, study groups, undergraduate research opportunities, team science competitions, and internships.
  4. As students transfer, they will continue to report in and be tracked in their transfer institutions, be invited back to mentor younger students at our College, and some will even be hired back as peer mentors, paving the way for students to transfer and at the same time, providing role models for the current College students.

The grant narratives list the following goals and outcomes of I-Cubed, TCUP and PEEC:

I-Cubed grant

Goal 1: Institute, build and sustain a formal STEM enterprise.

Goal 2: Increase the number of STEM faculty engaged in producing more Native Hawaiian and other STEM degree completers.

I-Cubed key outcomes will be:

  1. Establishment of a formal STEM enterprise which offers participants a coherent and integrated program of study;
  2. Increase in the quantity, quality and diversity of College STEM faculty who are engaged and prepared to instruct and mentor an increasingly more diverse student body;
  3. Building of the STEM pipeline for students in Hawaii, resulting in an increase of the numbers of Native Hawaiian and other STEM degree completers;
  4. Stimulation of changes in institutional policies and practices that will support and sustain the STEM program.

TCUP grant

Goal 1: A STEM Learning Continuum. To implement a new STEM Learning Continuum that advances NH students progressively from routine methodological expertise to more adaptive, hypothesis-driven expertise. This continuum will focus on biology, ecology, biotechnology, eco-engineering, and technology.

Goal 2: A STEM Community of Practice in the Life Sciences. To implement a NH Community of Practice that connects Native Hawaiian students, mentors and undergraduate researchers with faculty, researchers, and community partners, through funded positions for students, increased interaction in the STEM Learning Center and ahupuaa settings, and virtual communication strategies.

TCUP Outcomes based on key strategies

  1. A comprehensive and sustainable participant support system including SEEK and SURE summer bridges for 175 NH students, and funded positions as service coordinators (40), undergraduate researchers (125), peer mentors (75), returning peer mentors (40), and research interns (50) is developed.
  2. 140 NH students complete the ASNS degree in Life Sciences and/or transfer to biological science fields at UH Manoa or UH Hilo (80% completion rate).
  3. 100 NH students complete STEM baccalaureate degrees at UHM or UHH within the lifetime of the grant.
  4. New NH community partnerships, opportunities in competitive research in the life sciences, and private sector and state government investment provide a strong foundation for future sustainability and growth of the KCC Life and Physical Sciences program.

PEEC Grant

Goal 1: A Quality Pre-Engineering Core Curriculum: that prepares Native Hawaiian students for success in 

progressively higher level courses in their Engineering education, effectively integrating Calculus, and that is available online in every semester during the project and beyond.

Goal 2: A Community of Practice in Engineering: connecting NH students, mentors, and undergraduate researchers with nurturing advising, structured cohort experiences, quality curriculum, faculty/researchers, and community partners, through funded positions for students, increased engagement with engineering issues and industries, and online communication strategies.

PEEC Outcomes based on key strategies:

  1. 170 NH students complete 6 week Summer Engineering Experiences at KCC, UH MC, and UHMCOE.
  2. 50 students complete the ASNS degree in Physical Sciences at KCC.
  3. 155 students complete all of a shared 39-credit pre-engineering core curriculum and transfer.
  4. 124 NH students complete UHMCOE Bachelor of Science degree (80% completion rate).
  5. Improved Pre-engineering core curriculum available online to all ten UH campuses and beyond.
  6. Hawaii’s PEEC curriculum, support and engagement strategies disseminated statewide and nationally.
  7. Hawaii’s PEEC partnerships for sustainability established, and the program expanded to all ten UH campuses.

The proposed scope of services for the integrated grants evaluation of I-Cubed, TCUP, and PEEC, includes a combination of, though need not be limited to, the following tasks:

  1. Design and Development of an Evaluation Plan: The Evaluation Plan should include data identification, collection, analysis, and evaluation and interpretation of data protocols as required by the grant, including a detailed statement of the activities required to implement the various evaluations, the evaluation schedule, and the evaluator’s requirements to complete the evaluation. In addition, the evaluation plan should identify any critical activities that could be implemented for a faculty development program.
  2. Gather from three grants the summaries of project activities, results of recruitment and support activities, faculty development approaches, and copies of all deliverables.
  3. Provide formative and summative evaluation and analysis of program management and progress from the original grant narratives.
  4. Provide an assessment of program areas requiring improvement and to support beneficial program modifications.
  5. Evaluate and analyze professional development activities based on a framework that uses best practices research in effective STEM education.
  6. Prepare project deliverables including Semi-Annual, Annual and Final reports.
  7. Prepare reports that clearly evaluate the three grants both as individual grants and as integrated around the same over-arching purpose.

PROPOSAL FORMS for Request for Proposal (RFP) No. 0057002, to provide Grant Evaluation Services for the three grants are available from:

Dr. Robert Franco
Office for Institutional Effectiveness
Kapi‘olani Community College
4303 Diamond Head Road, Ilima 203
Honolulu, Hawai‘i 96816-4421

Offerors may request an official copy of the RFP and accompanying materials, including grant narratives, be sent to them by e-mail by providing the offeror’s name, address, contact person, telephone number, and e-mail address. Requests may be made via email to Robert Franco at bfranco@hawaii.edu.

Deadline for submitting written questions to Dr. Franco October 6, 2011, 4:00 p.m. HST

Deadline to receive responses written questions from Dr. Franco October 13, 2011, 4:00 p.m. HST

Closing Date for receipt of proposal October 27, 2011, 4:00 p.m. HST