Amongst high-achieving college students, an unidentified faculty that had obtained the third-most functions dropped out of the highest 10 after Naviance was launched. Excessive-achieving college students turned more likely to use to native faculties, which had been comparatively unpopular decisions earlier than Naviance.
Sabina Tomkins, an assistant professor on the College of Michigan’s Faculty of Data and lead writer of the examine, doesn’t know precisely why college students had been deterred, however she stated there are two doubtless explanations. One is that college students are intimidated once they see that their scores are barely beneath the common of beforehand admitted college students. Some youngsters may need to keep away from the danger of rejection altogether and play it secure, making use of solely to locations the place they’re extra prone to be accepted.
One other chance is that the scattergrams have an unintended advertising and marketing or promoting impact. College students might really feel extra motivated to use to the most well-liked colleges the place they see lots of inexperienced checks, displaying that many earlier friends have been admitted. College students can’t see the scattergrams for the least widespread colleges. To protect pupil privateness, excessive colleges generally suppress scattergrams for colleges to which fewer than 5 or 10 alumni have utilized. Small or far-away elite colleges can typically fall into this suppressed class. “When the varsity doesn’t present up as a scattergram, it may not cross their thoughts in the identical manner it could have earlier than,” stated Tomkins.
Tomkins solely had utility knowledge and doesn’t know the place college students enrolled in faculty. But when college students are making use of to fewer elite colleges, they’re doubtless entering into and matriculating at fewer of them too, Tomkins stated.
An earlier examine, published in 2021 in the Journal of Labor Economics, additionally discovered that Naviance’s scattergrams deterred college students from making use of to and enrolling in probably the most selective faculties. That examine checked out solely 8,000 college students at one unidentified college district within the mid-Atlantic area. On the time that examine was launched, some critics questioned whether or not the unintended penalties of scattergrams had been true nationwide. The bigger 2023 examine bolsters the proof that extra info isn’t at all times a very good factor for all college students.
Importantly, each research additionally discovered that the scattergrams inspired lower-achieving college students. They had been extra prone to apply to four-year faculties after seeing that their grades and check scores had been much like these of earlier college students who had been accepted. Earlier than their colleges bought Naviance, extra of those college students prevented four-year faculties and opted for two-year group faculties as an alternative. A separate physique of analysis has typically discovered that beginning at a four-year faculty, whereas dearer, will increase the probability of incomes a bachelor’s diploma and better wages after commencement.
Whether or not we must always care about college students attending probably the most prestigious and elite faculties is a matter of debate. Authors of the 2023 examine pointed me to Harvard economist Raj Chetty’s analysis, which has discovered that going to an Ivy League university or four other elite colleges, as an alternative of a high flagship public faculty, will increase the probability of turning into a CEO or a U.S. senator and considerably will increase a graduate’s possibilities of incomes within the high 1%. Nevertheless, attending an Ivy as an alternative of a high public flagship didn’t increase a graduate’s income on average.
The scattergram research appeared solely at excessive colleges that had bought Naviance’s product. The corporate was the primary to market scattergrams to varsities in 2002 and says its product reaches 9 million of the nation’s 15 million highschool college students. In response to GovSpend, which tracks authorities contracts, public excessive colleges have spent effectively over $100 million on Naviance, which, along with scattergrams, additionally permits highschool counselors to handle their college students’ faculty functions and ship transcripts to high schools. Rivals embody Scoir, Ciaflo and MaiaLearning, which all provide comparable scattergrams.
PowerSchool, the corporate that owns Naviance, factors out that analyzing small slices of its buyer base, as the educational researchers have, could be deceptive. In response to the info PowerSchool shared with me, 38% of the six million faculty functions that circulation by means of its platform annually had been despatched to “attain” colleges, colleges the place it could be difficult for a pupil to realize acceptance based mostly on their grades and check scores. A spokesperson stated that functions to achieve colleges have been rising yearly, proof that its product “doesn’t discourage college students from making use of to their attain or goal colleges.”
The corporate additionally highlighted the advantages for lower-achieving college students, asserting that the scattergrams “improve fairness.” Certainly, the sooner 2021 examine discovered that Black, Hispanic and low-income college students had been particularly extra prone to apply to and enroll in four-year faculties after utilizing Naviance.
I talked with a half dozen faculty counselors who work with highschool college students and so they stated they often didn’t see high-achieving college students getting discouraged after seeing scattergrams. “If something, I see the other,” stated Scott White, an unbiased faculty counselor in New Jersey and a former highschool steering counselor for over 30 years. “College students are over-applying, not under-applying. They throw in dream functions. If you happen to take a look at the Naviance scattergrams, they don’t seem to be in profile. ‘I do know I’m not gonna get in there, however I’m gonna apply there anyway.’ That’s extremely widespread.”
Amy Thompson, a university counselor at York Excessive Faculty exterior of Chicago, instructed me that the scattergrams are a “large hit” with highschool college students and get college students engaged within the faculty course of as a result of clicking on the info could be enjoyable and even addicting.
Just one counselor instructed me he had seen a case the place a pupil was discouraged after seeing scattergrams, however he stated it was an uncommon expertise. That doesn’t imply the researchers’ knowledge evaluation is flawed. It’s widespread for knowledge to level out issues that we’re not conscious of or that we can’t readily see.
The most important downside to scattergrams, in accordance with veteran faculty counselors, is that the knowledge is incomplete and can provide college students the false sense that admissions selections at elite colleges are based on grades and check scores. The scattergrams don’t present whether or not a pupil was an athlete, a musician or from a rich household with many generations of alumni. College students may see a inexperienced test with a low check rating and never respect that the scholar had different elements weighing in his or her favor.
Counselors instructed me the scattergrams are most helpful and correct for giant state colleges, the place there may be a variety of knowledge and the educational vary of previous admittees helps college students determine security and goal colleges. The extra aggressive the faculty, and the extra the faculty seems to be at elements apart from grades and check scores, the much less helpful the scattergrams.
And similar to the inventory market, previous efficiency isn’t any assure of future outcomes. Faculties fall out and in of favor. What was a security college one 12 months can unexpectedly rise in selectivity. A college that was as soon as onerous to get into can decrease its requirements in an effort to fill seats.
I don’t know that I care a lot about youngsters not making use of to sufficient Ivy League colleges. However it’s fascinating how the knowledge age adjustments our conduct for higher and for worse, and the way youngsters are influenced by spending hours and hours clicking on web sites and absorbing lots of knowledge.
This story about scattergrams was written by Jill Barshay and produced by The Hechinger Report, a nonprofit, unbiased information group centered on inequality and innovation in schooling. Sign up for the Proof Points newsletter.
