Hacker News new | past | comments | ask | show | jobs | submit
I broadly agree with the premise. As a PhD student in Computer Science, I feel there are some significant upsides to my work routine. LLM access has made many new domains more "accessible" to me which I otherwise would be too hesitant in investing my time in. For example, my area of research is computer systems which involves operating systems, distributed systems and more recently systems for AI. Within these, there is a wide breadth of topics/techniques one can employ and up until now, I have not gone deep into theoretical aspects of things like scheduling etc. But with access to LLMs, I feel like I can at least brainstorm from a high-level about these sub-areas that I am not well-versed in and the responses give me some relevant pieces to start exploring on my own, depending on what interests me more or the amount of time I want to spend on that sub-branch of a larger tree of ideas. However, the one thing I do have skepticism is the lack of awareness of blind-spots when dabbling into areas that I am not an expert in, and taking the LLM's lead in applying such techniques to some systems problems that I am working on. I often feel that I am not aware of what alternatives exist that the LLM has not explored for me, or if the directions it has proposed really do apply or have corner cases/assumptions that break in what I am doing. On the other hand, when working on something I have good intuitions about, I am often correcting the model's assumptions and it back-tracks what it told me. Unfortunately, I cannot do that comfortably with topics I don't have good intuition about which limits my confidence in "if this is the right direction to pursue."
As someone with a PhD in CS focused on NLP (I started my PhD in 2018 just as Transformers were introduced), and with a strong background in distributed systems owing to the fact that I was a lead developer of an MMO before starting my PhD, I can definitively say that any surface-level understanding you get by interacting with an LLM, is just that: surface level.

If that allows you to target your deep dives better, then great. If instead your deep dive into a topic is purely through prompting an LLM, that will almost certainly end with little functional domain expertise.

The absolute best experience you can get is by trying, failing, then improving upon your past failures. Remove that friction at your peril.