Hacker News new | past | comments | ask | show | jobs | submit
Human can be inspired. Machine can not. End of story.

All usage of open source to train LLM is basically a theft.

[flagged]
Chatgpt didn't just wake up one day and said today i have enough compute to solve this. Somebody basically pressed play.
You prompted it to solve a problem. But then it looked for inspiration after your prompt.
It looked in the database(model) built on top of stolen data which matched prompt the best. Machines don't have "inspiration".
Inspired or prompted? Didn't the machine wait idly with infinite patience until a person prompted it to solve the problem?
So the credit lies with the inspiration? Ergo copyright belongs to the prompter?
I don't know the answer to that but I know that a person can be inspired to steal.
loading story #50512293
> Human can be inspired. Machine can not. End of story.

Saying things with your chest out doesn't make them true. In fact, making sweeping declarative statements emphatically is very often a sign that you haven't really thought a subject through.

What do you base this opinion on?

The word "inspired" in this context literally means having your mind/heart/soul filled and guided by God.

So if you believe that's how things work, well, I'm not sure there's a way to reconcile the two sides of that argument.

loading story #50512217
Sure there is: Who wrote the prompt?

You can mock that as a insufficient as "inspiration", but then... what is photography? Click a button? It turns out there is a whole lot of human creativity that remains, from timing, settings and of course, curation. I can click a button, but I'm no Ansel Adams.

Terrence Tao might solve a 100 year old math problem with AI but I couldn't. I don't know where I would start, what to ask or how to ask, or even what problems are worth solving.

AI is a tool and modern copyright laws have nothing to do with human creativity. Split hairs about attribution and legality all you like. Every creative person driven by curiosity should feel empowered by AI. Every creative person driven by social or monetary reward should feel threatened. Both can be true.

God doesn't exist, so does that mean there is no such thing as inspiration?
Can you definitively prove God doesn’t exist?
You make the concrete claim. Therefore the burden of proof is on you
As a person who feels God's presence in his life: I can neither prove nor disprove the presence of an entity which exists outside the realm of physics by which myself I am bound.

It does, however, feel incredulous that somebody would believe that such as entity exists. Yet here I am, aware.

What is your reconciliation for the problem of evil?
I'm not Christian, so I don't hold that God is inherently Good only.

For that matter, I personally don't hold that the concepts of good and bad are even relevant - what is good for the cat is bad for the mouse. Nor do I think that we can even comprehend an entity so outside our everyday experience to even label it good or bad. I often can not even properly label my neighbours as good or bad. Nor do I demand consistency of an entity whose actions and motivations I am unable to comprehend. I can't even claim to be consistent in my handling of my own children, and I have far fewer children than God has of us.

Sure, there’s ambiguity, there’s uncertainty, the meaning (and our perspective) of an event evolves through time. But there are the atrocious and unnecessary evils that, if we are made in the image of god, should also disturb him into taking preventative action. And yet, radio silence.
Don't look at me. I'm not a dualist. I'm not sure LLMs in particular are "conscious", whatever that means, but I don't have any qualms whatsoever accepting that a machine intelligence could be conscious, because as far as I'm concerned we are also "machine intelligence", just squishier.
What are you talking about? How did you manage to involve, soul and, LOL, God?

Machine is not a person. It legally is not. It can't be "inspired", "taught", "have purpose".

You have a black box. You feed it stolen code. This code is used to write another code. It does not matter what's inside unless there is a human being.

Stolen content as input, stolen content as output. That's it.

Without that code which was fed to the box you wouldn't get the output you're getting.

All this nonsense about "inspiration", "education" and whatnot is just a legal gaslighting.

Want to prove me wrong? Create a model without all that stolen code as training data. Tweak all those weights by hand and we'll talk then.

I'm not going to address or defend your parent's comment here, but yours has a lot to be desired.

You are wrong on the legality of how LLMs train. US District Courts have ruled that it is fair use to train LLMs on copyrighted materials (like books)[1]. It is not "stolen" when you read a copyrighted book that you borrow from a library (which is the appropriate analogy for the vast majority of LLM training content). Your use of the word "stolen" here is either disingenuous or hyperbole. We know that Meta did train their LLM on some stolen / torrented content, but that is far from the majority of the training corpus.

The "inspiration" topic isn't "legal gaslighting". Humans learn via inspiration. It is the foundation of culture and the arts. You can't use a single English idiom without having heard and copied it before. But we don't sue for copyright infringement of idioms, for example. We have lots of "fair use" concepts established by law because the law recognizes that much of content produced everyday is derivative but mundane.

The important question then becomes: if you prompt an LLM for a unique work (making an attempt to avoid it regurgitating a single source verbatim) and it still outputs a verbatim copy of one of the training materials, what responsibility does the prompting user have to verify that the LLM's output content isn't violating IP (and also not covered by fair use)? This is the point of my comment above.

There are LLMs which are being trained entirely on permissively licensed content. But the quality of the output is bad because there simply isn't enough training data to train those models sufficiently. Hence there is pressure to make models usable by training on ALL data, not just permissively licensed data.

[1] https://www.linkedin.com/posts/andrewyng_judge-rules-trainin...

I don’t believe that basing anti-AI laws on Christian religious provenance is meaningfully better than basing pro-AI laws on Rationalist religious provenance.
Rationalism is NOT religious by definition.

What are you trying to say?

It's more of a cult than a religion, I guess
I don’t believe that basing anti-AI laws on Christian religious provenance

I'm curious why specify Christian provenance?

All he did was reference "God." Are you under the impression that only Christians have a god?

I officially approve LLMs training on all of my MIT licensed open source code. It's vastly more useful to me than the thousands of youtubers who are personally profiting from that same code selling courses and tutorials (who also are not stealing it).

So not all use to train an LLM is a theft!

So, do they follow MIT license and "include the original copyright notice and a copy of the MIT license text in all copies"?
it's not being copied. it's the basis for new code.

none of the youtube instructional videos for my stuff credit the license either.