Hacker News new | past | comments | ask | show | jobs | submit
gopalv | on: What it feels like to work with Mythos
> It worked for nine and a half hours.

> Again, it wasn’t perfect. As an expert, I was able to spot some errors and omissions (some as a result of the design I had asked for) that I had the AI correct

That's the bit that stuck out to me - that's longer than I would expect to work on a problem in a day or even expect to go back & fix the output of something that has a core reward loop of hours.

My customers are currently clamoring to push down my agent response times from 85 seconds down to below the 20s mark.

At the same time, it is very dissonant to see the industry heading towards hour+ long workflows with an agent.

matneyx | parent | next
In Claude's defense (and I cannot believe I'm defending it), I know no single dev who could create what it did (Concord), from a 19-page design document, in 9.5 working hours.

We're gonna go back to the days where our bosses ask why we're just sitting around, but instead of saying "compiling," we'll just say, "waiting for Claude."

torginus | root | parent | next
I tried to read the 'design doc' - its slop full of vague platitudes and impressive sounding but impossible to pin down management speak - in short, it's slop, and I still don't really get what its supposed to do exactly.

It's some prompt engineered AI harness, that guides the AI to create stats after it researches a subject and ingests the data, but I'm not sure what is it that the tool actually does on top of this.

giancarlostoro | root | parent | next
This. I get told things like "you can't build all that on your own?" I've had Claude poop out full feature web apps in under 30 minutes, to a spec. Was it perfect? No, but sometimes even in a simple setup phase you can burn 15 minutes to some obscure setup step that's failing. I cannot just code nonstop at 900WPM or whatever ridiculous speed, and poop out an entire full feature web app, with maybe a few bugs here or there. If you can, come show me, I'll gladly have you race against my Claude prompting capabilities.

Will Claude's code be perfect in one shot? Probably not, will it get you 80 to 90% of the way there with your chosen design patterns in under a few hours? Absolutely.

toss1 | root | parent
>>If you can, come show me, I'll gladly have you race against my Claude prompting capabilities.

Sounds like we've nearly reached in coding the point where Paul Bunyan [0] has his epic competition with the chainsaw... and loses by 1/4" and history forever changes...

[0]https://www.britannica.com/topic/Paul-Bunyan

petesergeant | root | parent
Sadly I didn't get very many answers to my Ask HN, "What are you doing during inference?": https://news.ycombinator.com/item?id=47944917
ModernMech | root | parent
I alt-tab to a MMO and farm XP.
giancarlostoro | parent | next
> At the same time, it is very dissonant to see the industry heading towards hour+ long workflows with an agent.

At this point, pay me significantly more, and I'll do it.

warkdarrior | root | parent
> pay me significantly more

Ha ha, that's how you negotiate yourself out of a job!

giancarlostoro | root | parent
Fire me then, I can bring someone else drastically more value with AI tooling.
hedgehog | parent | next
Work duration is also not that valuable of a measure, you're usually better off defining the process yourself in code and having that delegate chunks of work to the models. The only real issue there is that it's harder to take advantage of the providers' subscription discounts, but on the other hand it's easier to do your own model routing, and there's no way I've seen for the normal chatbots to maintain coherence on streams of work measured in days and weeks.
PeterStuer | parent | next
My Opus 4.8 regularly works for 10+minutes on a single non-trivial coding request.
ASalazarMX | root | parent
Your Opus 4.8? Is it now usual to refer to LLMs like that?
wongarsu | root | parent | next
Isn't it common to refer to all software like that? "Let my look at my JIRA", "I can't find anything using my Outlook's search function", "My Powerpoint is acting up today", "My browser just crashed" are all sentences I might say during a normal work day
hypfer | root | parent | next
Depends on the demographic I think. And also tells you surprisingly much about how the brain of person uttering it works.

There are people that almost feel physical pain if something is unnecessarily incorrect.

+ That if the mental model of something is accurate, it is actually _more_ work to say something that is incorrect than just saying the correct thing.

wongarsu | root | parent | next
In my mental model, "my Outlook" is the outlook instance running on my computer, on my data. My outlook crashed today. Yours might not have crashed. Similarly, my Jira contains tickets about my work, your Jira does not contain those same tickets. That might be technically the same instance on the same SaaS server, but the server I'm routed to accessing my data with my credentials turns it into "my Jira". My Jira is slow. Maybe you are lucky and get routed to a faster server, or your company is self-hosting. Then your Jira might be reasonably fast
hypfer | root | parent | next
Hmm, good point. "My outlook" might actually be correct. Depending on if it is a webapp or the real one running on your device that is.

Similiar to "My game just crashed".

Jira otoh is not yours, because it's in the cloud. It might be "my internet connection", "my browser" or "my account" that is having trouble.

___

Hm. "My train got delayed" is interesting in this context. I don't find that offensive. But that also might be because trains don't seek rent the way SaaS does? Not sure.

I guess trains do not hold me hostage. They might just be a container in which someone does that.

Jira, cloud LLM inference or similar otoh..

ASalazarMX | root | parent
The "my train" convention is an interesting argument. It's not actually yours, you're buying a train-as-a-service single-use license, and there are tiers to that too.

I guess the main difference is that TAAS has many different trains where the experience varies wildly, so it helps to be specific on which train you're licensing; but LLMs are the same product for everyone, and you can't stay with say, ChatGPT 1.0, you get the same choices as everyone else.

ASalazarMX | root | parent
This is completely fine, as those are your own installs, but LLMs can't be owned by the users, your Opus is the same Opus as everyone else's, your only difference is the suscription tier to their API.

If you had your own on-premises LLM, that would indeed be your LLM, and it would make sense to compare it to the on-premises LLMs of other people, as your setup particulars would affect the result.

dasyatidprime | root | parent
The copyright to the Outlook binary isn't owned by the users either, even if they're running it on local hardware. The Opus 4.8 weights are (we assume) the same between users, but the conversation/tooling state is not shared between them by default. I prefer to route around this construction myself, since I do think there's some ontological slippery-slope potential, but from a lexical perspective I think “my” is a perfectly defensible abbreviation in context.
hypfer | root | parent
> The copyright to the Outlook binary isn't owned by the users either, even if they're running it on local hardware

There was a time where one actually bought software to own it.

This time is.. actually it is right now. Please leave at once.

RugnirViking | root | parent
> tells you surprisingly much about how the brain of person uttering it works

That's ridiculous. You wouldn't respond to "I went to visit my doctor yesterday" with "but slavery has been illegal since forever!" Similarly it would be foolish to respond to "where should we meet? my place or yours" with "but we both rent!"

calvinmorrison | root | parent
better than "The JIRA" , or "The Google" or "The Spotify"
w4yai | root | parent | next
You don't have your Opus 4.8 ? I got mine yesterday !
ASalazarMX | root | parent
I didn't get mine, but I suspect I might be using yours when I use it.
giancarlostoro | root | parent
That's pretty tame, if you want to be disturbed check out r/MyBoyfriendIsAI
throw939494555 | root | parent
Or dog lovers. All sorts of licking, anal cleaning... full intimate relationship.
cyanydeez | parent
I think we hit the sigmoid back when the QWEN models were released. By properly structuring my project, I can point it at any extension I want and get it going for 30 minutes to extend whatever. It can't effectively do 'god mode' on all the code, but being a mindful observer and code "professional" I don't need more than what a 128GB VRAM needs.

I'm amazed we're so far into SOTA bloat that the chinese will kill once they start etching silicon with these models.