Hacker News new | past | comments | ask | show | jobs | submit

The Prompt() Function: Use the Power of LLMs with SQL

https://motherduck.com/blog/sql-llm-prompt-function-gpt-models/

  FROM hn.hacker_news
  LIMIT 100
"Oops I forgot the limit clause and now owe MotherDuck and OpenAI $93 billion."
I love the simplicity of this. Hurray for small models for small tasks.
Interesting -- is there any impact from LLM outputs not being deterministic?
SQL functions can be non-deterministic just fine. E.g. SQL:2003 grammar defines DETERMINISTIC | NOT DETERMINISTIC characteristic for CREATE FUNCTION. Or, e.g. PostgreSQL has IMMUTABLE | STABLE | VOLATILE clauses.
loading story #41874506
Aren't LLM outputs deterministic given the same inputs?
loading story #41874925
loading story #41874517