Hacker News new | past | comments | ask | show | jobs | submit

Kids who use ChatGPT as a study assistant do worse on tests

https://hechingerreport.org/kids-chatgpt-worse-on-tests/
When I was young, and learning math, my father always forbade me from looking at the answer in the back of the textbook. “You don’t work backwards from the answer!”, and I think this is right.

In life, we rarely have the answer in front of us, we have to work that out from the things we know. It’s this struggling that builds a muscle you can then apply to any problem. ChatGPT, I suspect, is akin to looking up the answer. You’re failing to exercise the muscle needed to solve novel (to you), problems.

loading story #41453540
loading story #41453546
>In life, we rarely have the answer in front of us,

this sounds a lot like the "when you're an adult, you won't always have a calculator in your pocket" line we all heard in elementary school. and of course, we all know now how wrong that was.

in life, chatGPT exists. and tools like it are only going to become more widespread. we are going to have the answers in front of us. knowing the things an LLM knows is not a useful skill anymore.

In order to develop the kinds of mental skills you need to tackle complex problems, you need to practice them on simpler problems first (particularly if you happen to be a child). If you decide at a young age it's worthless to attempt any problems that can be solved by a calculator or ChatGPT, you will probably never learn how to solve any problems that you can't use those tools for either.

Also, knowing what kind of things exist and what questions to ask is half the battle. If you haven't stored anything in your head on the grounds that you can outsource knowing things and thinking about them to ChatGPT, you're not going to be able to prompt it efficiently either. It's much harder to sanity check numbers and formulas given to you by others (or ChatGPT) if you can't do any quick mental math. Having original ideas that don't yet exist in LLM datasets also requires storing a lot of concepts and making new connections between them.

I suppose all this is moot if you expect AGI to be available to everyone in the near future, but if it turns out to be decades or more away unfortunately human mental effort will still be required in the meantime.

Not true. Current research is that experts are better with a ChatGTP, and beginners worse. An expert knows what to ask, and a beginner juat flails around.

Tools like calculators, ChatGTP, Google, and chainsaws are often force magnifiers for experts, and a danger for beginners.

If you have an idea of what you are trying to do at a deep level then they are great, but beginners don't, they usually just use them as a shortcut to avoid needing any real understanding of the space, and just get "the answer".

Although in some ways youre right. There will need to be changes in the skills we value, just churning out words, or calculating large sums and interating obscure trig functions will lose value.

loading story #41454164
>we all know now how wrong that was.

How wrong was it ? I find myself having to do head math every time I playing video games.

I do mental math pretty much every day. Even just going through the grocery store.

I also use things I learned from calculus and physics. Like when driving. No, not solving integrals all the time but it does teach you to focus on rates of change

Which video games?
League of Legends.

Just knowing that your combo can finish an opponent can switches your situation from very passive to very aggressive. Also some jungle / gank timing require clock math.

I think most serious / pro players memorize the numbers already. But casual players like me still have do head math.

This is about building [math] skill, not simply calculating a result
loading story #41453857
loading story #41453705
(1) chatGTP is not a calculator. A calculator resolutely computes the exact numerical answer (modulo finite bits and rational numbers etc). ChatGTP is more stochastic. sometimes it's right, maybe a lot of the time, but no promises! (2) said student is taking an exam to find answers without the benefit of ChatGTP. Thusly doing exercises in a ChatGTP will not benefit the exam in the same way someone who only uses the calculator will suck at mental math. similar to what some of us may have seen "no calculators allowed on math exam"

but the big hangup is that "stochastically correct/incorrect" part. Can't count on it, still need skillz. Maybe when straberry/q* drops things will change in this regard

The same holds for calculators. My university banned graphical calculators from math courses. It is too easy to plug in a formula and see the graph. But for mathematical intuition, they want you know how formulas look like from your memory.
Mechanical aids—be they abacuses, slide rules, pocket calculators, supercomputers, or large language models—will never replace the need to reason.
Unless you can do the task yourself, you have a very hard time figuring out whether the LLM hallucinates or not. Relying on ChatGPT for your education is the path towards believing fake news.
Except you still have to validate ChatGPTs answer... Even answer keys in text books are sometimes wrong, teachers are sometimes wrong. ChatGPT is often wrong. You still need to learn the skills.
loading story #41453995
loading story #41455837
loading story #41453592
loading story #41453556
loading story #41453666
loading story #41459928
loading story #41453714
loading story #41453568
loading story #41453513
loading story #41453689
loading story #41453628
loading story #41453452
loading story #41453500
loading story #41453634
loading story #41453461
loading story #41455852
loading story #41453524
loading story #41453518
loading story #41453515
loading story #41453554
loading story #41453443
loading story #41453466
loading story #41453473
loading story #41454803
loading story #41454247
loading story #41453549
loading story #41453537
loading story #41453444
loading story #41455920
loading story #41453497
loading story #41453681
loading story #41453512
loading story #41458187
loading story #41453494
loading story #41454022
loading story #41453757
loading story #41453803
loading story #41453471
loading story #41453509
loading story #41454142
loading story #41453702
loading story #41454452
loading story #41453498
loading story #41453948
loading story #41454521
loading story #41453622