Hacker News new | past | comments | ask | show | jobs | submit
Aardappel | on: The Goose Programming Language
Because you really can't do all the static checking and convenience like that with a library.

As for the benchmarks, that's exactly what I do: https://aardappel.github.io/goose/bench/results.html

If you mean the other benchmarks (LangArena), I don't control their design.

ModernMech | parent
But it's not infeasible as a preprocessor or macro though, since you're outputting C anyway right? You could even output C++ or Rust.

> As for the benchmarks, that's exactly what I do

What I mean is the story of those benchmarks is incomplete, you're missing a column for optimized Rust. This is what I get on my M1 if I ask the LLM to write more performant (still safe) solutions to a couple benchmarks, I'm sure your LLM can do the same:

  | Benchmark | vs original Rust | vs optimized safe Rust | Memory vs original Rust | Memory vs optimized safe Rust |
  |---|---:|---:|---:|---:|
  | `sexp` (flagship workload) | 1.00× | 0.95× | 2.22× | 1.60× |
  | `records` | 1.52× | 0.54× | 4.77× | 2.58× |
  | `graph` | 1.24× | 0.75× | 1.00× | 1.00× |
I think for the Benchmarks Game entry specifically, for the expert solutions you should use submissions to the game for both C++ and Rust instead of LLM generated code. After all, those are legitimate expert-implemented solutions to the benchmark, so it's nice to not have to lean on an LLM there. That would also give you something to optimize towards.