Higher Education News

Could Grades Be Counterproductive?

Chronicle of Higher Education - August 10, 2017 - 8:16pm
A University of Georgia professor’s offer to change students’ grades upon request raises intriguing questions.
Categories: Higher Education News

An Anti-Hate Group Has This Advice for When the Alt-Right Comes to Campus

Chronicle of Higher Education - August 10, 2017 - 7:10pm
The Southern Poverty Law Center lays out some strategies for student activists who want to oppose speakers with racist views but avoid a spectacle on their campuses.
Categories: Higher Education News

Purdue Wins State Approval for Controversial Deal With Kaplan U.

Chronicle of Higher Education - August 10, 2017 - 4:13pm
Opposition was not expected from Indiana, and the transaction now moves to the U.S. Education Department for additional review. One outspoken critic outlined his objections in a letter to a top department official.
Categories: Higher Education News

Former Official Sues Southern U. Over Termination

Chronicle of Higher Education - August 10, 2017 - 12:37pm
Brandon Dumas, a former vice chancellor on the Baton Rouge campus, was fired a few days after the university said it would investigate a sex tape allegedly involving a student and an employee.
Categories: Higher Education News

Big-Time Sports Programs Tighten Rules on Athletes With Sexual-Assault Records

Chronicle of Higher Education - August 9, 2017 - 9:00pm
The wealthiest athletic conferences and some of their members have taken steps to bar players who commit sexual misconduct or other forms of violence. Advocates wonder if the bans will work in practice.
Categories: Higher Education News

In Higher Ed’s Mental-Health Crisis, an Overlooked Population: International Students

Chronicle of Higher Education - August 9, 2017 - 4:10pm
Some come from cultures that see mental illness as weakness or fiction. When the stress of being in college alone and far from home becomes too great, it’s sometimes the job of advisers to teach them that the disorders — and the dangers — are real.
Categories: Higher Education News

Eight Lessons Learned From Piloting the Rapid Cycle Evaluation Coach

U.S. Department of Education Blog - August 9, 2017 - 2:23pm

Mrs. Lowerre’s class” by diane horvath is licensed under CC BY 2.0.

 
For the last 18 months, the Office of Educational Technology at the U.S. Department of Education, in partnership with the Institute of Education Sciences (IES) at the Department, has been working with Mathematica Policy Research and SRI International to build the Rapid Cycle Evaluation Coach (the RCE Coach). The RCE Coach is a free, open-source, web-based platform to help schools and districts generate evidence about whether their educational technology apps and tools are working to achieve better results for students. The platform was released in Beta in October 2016 and updated in January 2017. The RCE Coach currently includes two types of evaluation designs:

  • matched comparison, which creates two similar groups of users and non-users of an ed tech application already in use at a school site and;
  • randomized pilot, which randomly assigns participants to groups of users and non-users of an ed tech application that has not yet been implemented.

While the tool is free and open for any school or district to use (and many have done so already, with over 1,700 individuals registered), we worked closely with 12 districts to pilot the RCE Coach, and six of the pilots are already complete. The pilots spanned the two evaluation designs and studied how selected math or literacy products affected student academic achievement. Below are eight lessons we’ve learned from these initial pilots.

Lesson 1. The central problem addressed by the RCE Coach — the need for better evidence for making decisions about whether to use ed tech in schools to inform implementation of best practices and procurement — has broad resonance in the field.

In conversations with district staff, we heard repeatedly that people want to know whether the technology they use is making a difference for students and is worth the cost, and that evidence should be more rigorously and systematically generated.

Lesson 2. Moving from broad to narrow research questions is an important part of the process.

Rapid-cycle evaluations — rigorous, scientific approaches to research that provide decision makers with timely and actionable evidence of whether operational changes improve program outcomes — work best for narrow questions that address specific implementations of technology, but most districts start from a different point.

Many of our pilot districts stated their research questions in very broad terms. For example, they wanted to know whether technology in general is moving the needle or whether a school wide technology-based intervention is working. Rapid-cycle evaluations can be most useful in examining whether components of a school improvement plan are having the desired effect on student outcomes or whether the desired effect is coming from one particular technology for a targeted group of students.

Lesson 3. The RCE Coach needs to have the flexibility to meet districts where they are.

Many districts want to know if the technology they are already using is helping students, but they lack the ideal conditions for a causal impact study. For example, a school may have rolled out a new app to all students, but only certain teachers actually used it with their students.

Therefore, it is important that the RCE Coach help users determine what types of analyses are possible and appropriate given their unique circumstances. It’s also important to be clear about the strength of the evidence provided under these different cases so that districts can use the information appropriately.

Lesson 4. Having a champion in the right role at the school or district is crucial.

Rapid-cycle evaluations can fall into the tricky space of being perceived as important but not urgent. Thus, they are susceptible to delays when more pressing tasks arise.

We hypothesize that districts are most likely to complete the evaluations when there are staff dedicated to data analysis or curriculum directors who have less exposure to the pressures of day-to-day school operations. Over the next year, we hope to learn more about the skill sets necessary to successfully navigate the RCE Coach independently and how the RCE Coach can best be embedded into existing operations.

Lesson 5. Large systems may see the RCE Coach as a resource for local capacity building.

A large district with a central data analysis, program evaluation or research unit may choose to train staff in schools to use the RCE Coach in order to build local capacity and enable the study of more technologies than one central team could test alone. Several state departments of education also expressed interest in disseminating use of the RCE Coach into their districts.

Lesson 6. The RCE Coach can support common approaches to evaluation.

At present, within a district, people may use inconsistent approaches to evaluating the effectiveness (and cost-effectiveness) of ed tech. Consequently, weighing the relative effectiveness of different technologies and prioritizing use of resources can be challenging. One pilot district views the RCE Coach as a tool for supporting common approaches to evaluation across a school, district, or state so that decisions can be made based on more comparable information.

Lesson 7. Practices associated with collecting, reporting, and interpreting usage data are still emergent.

In theory, detailed information about whether and how students, teachers, and other users interact with systems, as well as about their performance on embedded evaluations, should be a treasure trove for ed tech evaluations. In practice, several obstacles impede routine use of these data for evaluation purposes.

Key obstacles include the following: (1) There is substantial variation in what types of user interactions are captured and how they are presented by developers; and (2) With usage data, there is wide variation in terms of availability and ease of use.

From a policy perspective, it may make more sense to encourage developers to invest in standardized reporting functionality than to encourage responsiveness to requests for customized reports. For the RCE Coach, we have developed several templates with common indicators of use, progress, and performance. However, we recognize that the development of standards for system data reporting is likely to be a long-term, more organic process.

Lesson 8. Ed tech developers are important partners for RCE.

Districts can in theory conduct RCEs without developer assistance, provided that they have information about who is using the technology and who is not. However, RCEs will often provide more meaningful insights about effectiveness and strength of implementation with the cooperation of developers. Moreover, a productive partnership can facilitate the process of assembling data sets and make best use of usage data.

A number of developers have shown interest in getting involved with the RCE Coach in order to demonstrate the value of their products and deepen engagement with districts. However, we have also encountered reluctance from a number of developers to participate in RCEs, primarily due to the risk of unfavorable results, the potential drain on time and staff, and their lack of control over implementation.

We hope that these fears will abate as RCEs become more established. We also hope that developers will come to view RCEs as an opportunity to learn how and when their products are most effective and to build their evidence base.

In the coming months, we are soliciting more districts to pilot with us. We are also collecting and building resources aimed at helping schools and districts determine concrete outcome measures for ed tech applications that fall outside of the student academic achievement realm. These include identifying outcomes for student non-academic achievement (like grit, motivation, self-awareness, engagement, etc.), and outcomes for ed tech that facilitate teacher professional development and staff productivity.

Additionally, as we continue to pilot the RCE Coach, we are planning to document, in detailed case studies, the areas that cause the most confusion in the rapid-cycle evaluation process. For example, be on the lookout for an upcoming resource that will be embedded directly in the RCE Coach that details how to design a successful pilot. This resource covers topics like randomization, number of participants, unit of assignment, data availability, and selecting meaningful probability thresholds. Additionally, we’ve added a facilitator’s guide on how to demonstrate the platform for those school and district leaders who would like to lead their own trainings on the RCE Coach.

We hope to see more schools and districts pilot the RCE Coach and continue to help us learn and grow from the lessons we’ve already gleaned. For those interested, you can fill out a brief survey here.

Jackie Pugh was a research fellow in the Office of Educational Technology at the U.S. Department of Education for a year, through May 2017.

Alexandra Resch is an associate director and deputy director of state and local education partnerships at Mathematica Policy Research, specializing in rapid-cycle evaluation and evidence-based decision making.

Rebecca Griffiths is a senior researcher in SRI International’s Center for Technology in Learning.

Cross-posted at: https://medium.com/@OfficeofEdTech/eight-lessons-learned-from-piloting-the-rapid-cycle-evaluation-coach-1f7f681af96f

The post Eight Lessons Learned From Piloting the Rapid Cycle Evaluation Coach appeared first on ED.gov Blog.

Categories: Higher Education News

Marygrove College to Eliminate All Undergraduate Programs

Chronicle of Higher Education - August 9, 2017 - 9:29am
To remain financially viable, the Board of Trustees decided to turn the Michigan college into a solely graduate institution.
Categories: Higher Education News

New Venture Will Offer Free Courses That Students Can Take for College Credit

Chronicle of Higher Education - August 9, 2017 - 3:00am
The leaders of Freshman Year for Free call it an “on ramp” to college. It’s backed by a philanthropy in New York City called the Modern States Education Alliance.
Categories: Higher Education News

Were Red Flags Missed in U. of Southern California Dean’s Hire?

Chronicle of Higher Education - August 8, 2017 - 8:32pm
Before allegations of drug-fueled partying undid Carmen Puliafito’s reputation, the former medical-school dean settled an assault lawsuit and faced sexual-harassment allegations at the University of Miami.
Categories: Higher Education News

The Faculty Club: Not Dead Yet

Chronicle of Higher Education - August 8, 2017 - 7:48pm
The once-exclusive organizations have struggled to attract young faculty members. But now, with many professors craving more collegiality, officials at Ohio State and elsewhere see a chance for revival.
Categories: Higher Education News

Secret Meetings and Aliases in a Presidential Search Rekindle Debate About Openness

Chronicle of Higher Education - August 8, 2017 - 7:34pm
The University of Florida chose W. Kent Fuchs as its new president in 2014 only five days after he formally applied, but talks with individual members of the search team had started earlier.
Categories: Higher Education News

U. of Georgia Prevents Professor From Including ‘Stress-Reduction Policy’ in Syllabus

Chronicle of Higher Education - August 8, 2017 - 1:50pm
As originally written, the policy would have allowed students to choose their own grades and abandon group work and meetings without explanation.
Categories: Higher Education News

UC-Berkeley's Former Chancellor Will Be Paid $434,000 on Leave

Chronicle of Higher Education - August 8, 2017 - 12:36pm
A University of California policy allows executives to receive a year off with pay to pursue research that may have been stalled by administrative work.
Categories: Higher Education News

College Diversity Officers Face a Demanding Job and Scarce Resources

Chronicle of Higher Education - August 8, 2017 - 3:00am
Many of them grapple with political and financial pressures, but they’re still largely satisfied with their role, a new survey finds.
Categories: Higher Education News

Elsevier Is Becoming a Data Company. Should Universities Be Wary?

Chronicle of Higher Education - August 7, 2017 - 9:39pm
For years university researchers have complained that the publishing giant has driven up the costs of journals. Now, as data-sharing becomes more valuable, the company’s shifting focus is raising new concerns.
Categories: Higher Education News

‘Driverless’ Van Turns Out to Be Va. Tech Researcher Costumed as Car Seat

Chronicle of Higher Education - August 7, 2017 - 4:51pm
What only appeared to be a van with no driver was actually an experiment by the Virginia Tech Transportation Institute.
Categories: Higher Education News

Education Dept.’s Progress Is Stalled in Complying With Consumer Rule

Chronicle of Higher Education - August 7, 2017 - 1:14pm
In a letter last week, Education Secretary Betsy DeVos said her department does not have “any timetable” for generating data to comply with the Obama-era gainful-employment rule.
Categories: Higher Education News

Fresno State Says Lecturer Who Tweeted ‘Trump Must Hang’ Won’t Teach This Fall

Chronicle of Higher Education - August 5, 2017 - 2:30pm
Lars Maischak came under fire after Breitbart News drew attention to a series of his controversial tweets.
Categories: Higher Education News

What’s New in Freshman Housing? Buildings That Help Students Make Friends

Chronicle of Higher Education - August 4, 2017 - 5:39pm
As colleges tailor residences to the needs of first-year students, architects find that what works best isn’t what students say they want.
Categories: Higher Education News

Pages

Subscribe to Western Interstate Commission for Higher Education aggregator - Higher Education News