The Prompt() Function: Use the Power of LLMs with SQL
https://motherduck.com/blog/sql-llm-prompt-function-gpt-models/ FROM hn.hacker_news
LIMIT 100
"Oops I forgot the limit clause and now owe MotherDuck and OpenAI $93 billion."I love the simplicity of this. Hurray for small models for small tasks.
Interesting -- is there any impact from LLM outputs not being deterministic?
SQL functions can be non-deterministic just fine. E.g. SQL:2003 grammar defines DETERMINISTIC | NOT DETERMINISTIC characteristic for CREATE FUNCTION. Or, e.g. PostgreSQL has IMMUTABLE | STABLE | VOLATILE clauses.
loading story #41874506
Aren't LLM outputs deterministic given the same inputs?
loading story #41874925
loading story #41874517