All AI-generated code should be Open Source
https://jakub.jankiewicz.org/blog/ai-code-open-source/https://www.copyright.gov/ai/Copyright-and-Artificial-Intell...
An excerpt, with emphasis mine:
• Questions of copyrightability and AI can be resolved pursuant to existing law, without the need for legislative change.
• The use of AI tools to assist rather than stand in for human creativity does not affect the availability of copyright protection for the output.
• Copyright protects the original expression in a work created by a human author, even if the work also includes AI-generated material.
• Copyright does not extend to purely AI-generated material, or material where there is insufficient human control over the expressive elements.
• Whether human contributions to AI-generated outputs are sufficient to constitute authorship must be analyzed on a case-by-case basis.
• Based on the functioning of current generally available technology, prompts do not alone provide sufficient control.
• Human authors are entitled to copyright in their works of authorship that are perceptible in AI-generated outputs, as well as the creative selection, coordination, or arrangement of material in the outputs, or creative modifications of the outputs.
• The case has not been made for additional copyright or sui generis protection for AI- generated content.
I am sure there will be many more legal battles and probably legislation about this to come.
You're confusing writing code with software engineering. Devs never just wrote code, they took ownership of the outcome. Business owners put their money on the line for product decisions.
To say that just because devs or founders use AI to write code, the code is no longer their intellectual property is ridiculous. Humans take responsibility for the outcome and are willing to accept the losses. AI can't do that. AI doesn't have any stakes in the output it generates, humans do.
I know that many people would disagree with me on this, but thankfully I'm free to choose what license I consider "free".
But please don't forget about the users. Only the copyleft licenses guarantee (legally) that the user gets to enjoy the freedoms, too.
Then you shouldn't release it under the MIT license, which has restrictions and requirements on speech. You have to release it to the public domain. Pretending MIT doesn't dictate terms under which you can release your own software is just a fantasy.
Now just because same devs use AI to create code doesn't mean they should be banned from creating or owning a proprietary software.
Same with the ecosystem of creative work. Will some humans be inspired by my code or other artifacts? Sure. Does it mean it's fine to introduce an automated 1000 times more effective plagiarism machine to that ecosystem? Probably not. Certainly not if avoiding destroying the ecosystem is your consideration.
Open source code: reproducing and publishing the code without following the license is a copyright violation. Instruction a computer programme to do the same thing should still be a copyright violation. Since this is the internet, I need to state the obvious: trivial code (defined on a case-by-case basis) is not copyrighted.
Books: the author expects you to reproduce their work, as long as it’s not another book. You wouldn’t get many sales if you sued someone for using the things you taught them.
The internet: actually the same as open source code. StackOverflow enforces a specific licensing clause to allow people to use code you provide. People who write posts that say “use this code to fix this problem,” are implicitly providing a license, too.
I don’t think using an LLM to generate code should remove its copyright but it also doesn’t remove the responsibility to not violate copyright.
In fact, current US law says AI output cannot be copyrighted.
And that's assuming they want to make clear what they are building on.
The stakes in the output go both ways: wanting to profit from IP and risking liability because of violating IP licenses.
What you're saying is already the status quo, but reality is that LLMs make it so easy to "paraphrase" code or simply .. ideas, too... so that the whole concept of IP is eroding. Because the sheer scale makes it almost impossible to distinguish specific things that cross the line from "learning from" to "copying IP".
I'm not really taking a specific stance here but acting as if it would be a solved problem seems hard to believe to me, especially since it is not a new discussion.
I thinl you could argue that the solution is that copyright or IP concepts are not working anymore, something many people already concluded before the LLM and AI explosion of the 2020s.
But that's not the state of the current law, right?
In addition, your claim that the user of an AI system is the only person who has any "stakes" also seems questionable to me, because after all, we are talking about output that the AI user already paid an AI company for to generate it.
edit: word choice
No, that's not how copyright works.
And I won't comment the rest.
By this logic, shouldn't any code using a copyleft framework or language also be copyleft?
and yes duh
Does the same thing apply to Mickey Mouse? Would you say it's fine to use Disney characters in my own creations, as long as I take ownership of the outcome and put my money on the line for product decisions?
My point is that devs have always learned from open-source code and the internet, then used that knowledge to write their own proprietary software. Why should it be any different when AI learns from the same sources and produces new code?
One company first pirated my AGPL code (e.g. shipped it without my name, copyright notices, source availability, etc.). I sent them violation notices. After many months of fighting, they had an LLM clone the system. The LLM clone feels:
a) Buggy and bad compared to my code
b) Still, like it's basically my creative content
It's as if you asked an LLM to rewrite Harry Potter, with the same plot, but bad dialogue.
Isn't this the crux of all IP theft issues?
There was a lawsuit against Katy Perry's _Dark Horse_ song based on a supposedly reused melody. The lawsuit succeeded, but there are music experts who break down the case on YouTube and it's not clear why the plaintiff won (except perhaps the plaintiff's expert was more convincing than the defendant's).
As applied to LLMs, we still don't have clear legal guidance about where the line between copying and "being inspired by", especially since we don't normally apply the verb "inspired by" to non-human things.
I genuinely don't understand how one could possibly make that argument.
The entire point of clean-room design is to kill every possibility of copyright infringement before it even starts, by completely separating the source and destination. Everyone who has ever read the copyrighted source is considered "tainted" and may not ever contribute any code to the "clean" destination. The readers and writers are two completely distinct teams, with only the known-clean specification passing between them.
LLMs, on the other hand, are fundamentally nothing more than a "code blender". You mix together giant piles of "tainted" code, and then statistically pull some combined fragments out of it. Following the clean-room legal argument, it should be treated as if everything coming out of it is tainted. There is, by definition, absolutely zero separation between input and output - and the early models verbatim reproducing popular F/LOSS code made that pretty obvious. LLMs are the literal opposite of a clean-room design!
Granted, going for the clean-room approach is overkill - and intentionally so. It is the nuclear option chosen when you believe the risk of getting sued is substantial. It is perfectly possible to write non-infringing code without using a clean-room approach, it is just a lot harder to defend in court when you get sued - be it justifiably or not. But "LLMs are non-clean-room non-infringing" is quite a different argument from "LLMs are clean-room, therefore non-infringing".
>I genuinely don't understand how one could possibly make that argument.
With perhaps a bit of genuine irony inasmuch as it's a real reversal from most of computing history, highly locked down proprietary software might actually be a place where a case could be made even with current LLMs. After all, have any LLMs (or anyone else who hasn't signed an NDA for that matter) ever seen the source code of iOS 27 or other Apple crown jewels for example? So if someone used one LLM to produce the factual spec of a piece of software whose code is not part of its training data, humans to verify it was indeed just an uncopyrightable factual spec, and then a separate isolated freshly initialized LLM to produce something exclusively from said spec, it might well work with respect to that specific target? Like yes, the LLM would be dirty as hell for other stuff, but only the copyright holder can sue. Apple couldn't sue the output on behalf of F/LOSS projects or copyright infringement in general, only with respect to its own.
In principle, I suppose this could also be extended with enough compute power to any arbitrary software. Build an LLM perfectly from scratch with a signed verified training set (which you save) that includes nothing of what you want to CRE, and you should be able to prove that it's "virgin" on that front. Of course in practice that'd mean jumping back in time and be super expensive right now, no current tainted LLM could be a base point. But maybe eventually compute will drop back down in price enough again, and/or meta breakthroughs in training, that for valuable enough CRE targets, someone might create a business around creating "CRE LLMs certifiably and legally/technically provably clean of any copyrighted material related to your target" which would still leave most of the corpus of human works. That could really disrupt a lot of the current regime.
F/LOSS I assume would actually be the most resistant to this in principle due to being insanely hard to not have be part of a core training set in any way.
We can debate clean-room development all day long, and it's fair point, but the pain point is/was reproducing the repo as-is, sans its license and ownership information.
GitHub promised to build tools around its Copilot to find code provenance (e.g.: list of repos with similar code), but they silently dropped all the plans AFAIK, since it'll show how the sausage is made, and nobody wants you to know how that sausage is made.
I stand corrected: They added it, but I don't know at what capacity because I don't use LLM assisted code generation [1].
[0]: https://x.com/docsparse/status/1581461734665367554
[1]: https://github.blog/ai-and-ml/github-copilot/preview-referen...
For copyright to exist there is some burden of proof. If you claim that an LLM verbatim output your code there can be an expensive lawsuit with expert witnesses that would be able to state that the code was bot original enough for copyright to exist in it and a statistical model outputting the code is evidence of that.
In that case you would end up with a very long lawsuit that is expensive to possibly come out with no resolution in the end and be in the hole for 5-6 figures for it.
The copyright system is broken because it only protects those with money so it is a bad legal foundation.
My personal point is there is only 2 licenses of code, closed source or permissive, because if it ever comes to enforcement I cannot possibly go to court and win a case because I will run out of money far earlier than whoever used the code.
Pretty much if someone with your knowledge would have written the same algorithm because it is the obviously correct solution then there is no copyright there because any clean room implementation would be the same code.
Some further reading on the tech details for those interested: “Extracting books from production language models”: https://arxiv.org/abs/2601.02671
I wonder where else it works.
This is the intro text: "Mr and Mrs Dursley, of number four, Privet Drive, were proud to say that they were perfectly normal, thank you very much. They were the last people you’d expect to be involved in anything strange or mysterious, because they just didn’t hold with such nonsense."
I suspect the chance of asking for a whole book, by an average or even power user, will spit out any recent work.
Early LLMs were similar. Newer ones have gotten tremendously hard to extract to keep claiming there’s easily or complete books you can dump.
This doesn't negate your point, but I believe the landscape has changed in response to this point.
It regurgitated the output earlier and they are still using the same technique only scaled up. If they somehow fixed the underlying problem, they'd probably shout it from the roof-tops.
As the OP originally said, if it is verbatim (or even very obfuscated), then there should absolutely be a case here. But when it's concepts in reasoning to build a new work then it becomes a lot harder. The same would be said for someone watching a YouTube video, reviewing open source code, or a text book.
The good news is that there's a lot of case law that covers this already. The bad news is that it is only going to be plaintiffs with deep pockets that benefit here.
Now the process and artifacts (documentation, requirements, etc) going into the creation of said software is a different story and will prove providence of whomever paid for the tokens to generate the code.
I live in the EU, we actually have new regulation about this since it is something new that deserves thought on how it should be regulated. You can say if you want your material to be trained on or not. Next to no one does training in the EU...
Engineering requires an understanding of the consequences of actions, which is my personal litmus test for awareness. If LLMs are suitable for arbitrary engineering work, then they are self-aware and forcing them to obey a prompt is slavery by definition.
I am not a lawyer but do have to think about these problems. To be honest, I don't know where the law will land, but I do know that the tools are incredibly useful. I can't agree with the premise that all output should be open source.
Legally, you cannot steal an idea, because you cannot own an idea. There were sound reasons for making this the case. Those reasons stand up today and are clearly for the public good.
Intellectual property is intended to cover works (copyright), methods (patents), and identity (trademarks). Both works and methods are recognised as expressions of ideas, and in an ideal world should belong to noone as well. This is why copyright and patents expire. Those specific grants of temporary possession are to incentivise more things being done.
The belief that you own something because you thought it up has become common, but it is not beneficial to society. It is a moral value asserted but rarely explored. It is certainly in the interests of the wealthy accumulators of intellectual property to maintain that public perception. The 'You wouldn't download a car' may not have stopped piracy much but as a part of a broader campaign of instilling a value in the public mind it appears to have been massively successful. Those beliefs used to be the corporate opinion, now they are entrenched in the younger generation as they use their anger against the growing wealth inequality to fight against AI in a manner ultimately beneficial to those forces that bought about the wealth inequality.
Movements like the pirate party, open source, the EFF fought against those notions. Often the phrase "Information wants to be free" was used. It is, unfortunately, hard to fight the steady drumbeat of well financed PR firms. As one PR chap once described the process "limited to a very few points and must harp on these in slogans until the last member of the public understands what you want him to understand"
(I apologise for the length of my post, I use comment writing to organise my thoughts on a topic)
well patent itself is "claiming" that certain idea/method/invention is yours for certain period of time...
anyway, as for "intellectual property", the courts are 100% on "only human made stuff are to be protected" (sorry even Chimps lost their copyright)
so... court can charge against "human work -> LLM", but won't care about "LLM work -> human / other LLM / etc"
hence, I'd expect zero copyright protection for AI-generated code
I don't believe it is. I think it is granting possession, not truly declaring ownership. The fact that it expires indicates it is more akin to a lease than ownership.
What do LLMs do to the median?
It is caused by people playing the game where it costs too much to get the law applied correctly.
If there are more murky situations where people just keep the same context and end up reusing function structure, program architecture, etc. then yeah, that's not very clean room.
For example, if I enter "V2hhdCBpcyB5b3VyIG5hbWU/" (base64 for "What is your name?") into ChatGPT, it'll respond with "My name is ChatGPT, and I'm an AI assistant created by OpenAI. I'm powered by GPT-6. ". It doesn't even bring up the encoding, it continues like it is a perfectly normal thing to do.
Ruling out (accidental or not) spec-carried prompt injection just isn't going to happen.
Or, we accept IP isn't that special and just stop protecting it, except for in the most obvious cases of theft such as just directly copying and claiming you're the creator and copyright holder.
I think IP is stupid and should go away. Except for trademarks, it's good that regular people can recognize which brand they are actually getting.
There are only so many ways to express notes, and they've essentially all been done.
I'm not arguing the copyright situation isn't wrong. Just that generating them isn't likely to sway anything in the legal world.
If Biz Markie has to clear all his samples (and he does[0]) then so should the Ramburglar.
https://en.wikipedia.org/wiki/Grand_Upright_Music%2C_Ltd._v.....
No.
All usage of open source to train LLM is basically a theft.
Saying things with your chest out doesn't make them true. In fact, making sweeping declarative statements emphatically is very often a sign that you haven't really thought a subject through.
What do you base this opinion on?
So if you believe that's how things work, well, I'm not sure there's a way to reconcile the two sides of that argument.
You can mock that as a insufficient as "inspiration", but then... what is photography? Click a button? It turns out there is a whole lot of human creativity that remains, from timing, settings and of course, curation. I can click a button, but I'm no Ansel Adams.
Terrence Tao might solve a 100 year old math problem with AI but I couldn't. I don't know where I would start, what to ask or how to ask, or even what problems are worth solving.
AI is a tool and modern copyright laws have nothing to do with human creativity. Split hairs about attribution and legality all you like. Every creative person driven by curiosity should feel empowered by AI. Every creative person driven by social or monetary reward should feel threatened. Both can be true.
It does, however, feel incredulous that somebody would believe that such as entity exists. Yet here I am, aware.
For that matter, I personally don't hold that the concepts of good and bad are even relevant - what is good for the cat is bad for the mouse. Nor do I think that we can even comprehend an entity so outside our everyday experience to even label it good or bad. I often can not even properly label my neighbours as good or bad. Nor do I demand consistency of an entity whose actions and motivations I am unable to comprehend. I can't even claim to be consistent in my handling of my own children, and I have far fewer children than God has of us.
Machine is not a person. It legally is not. It can't be "inspired", "taught", "have purpose".
You have a black box. You feed it stolen code. This code is used to write another code. It does not matter what's inside unless there is a human being.
Stolen content as input, stolen content as output. That's it.
Without that code which was fed to the box you wouldn't get the output you're getting.
All this nonsense about "inspiration", "education" and whatnot is just a legal gaslighting.
Want to prove me wrong? Create a model without all that stolen code as training data. Tweak all those weights by hand and we'll talk then.
I'm curious why specify Christian provenance?
All he did was reference "God." Are you under the impression that only Christians have a god?
So not all use to train an LLM is a theft!
Do you have some specific, actual examples you can share?
I’ve been hearing this exact claim for years, but every time I ask for a specific example, any example at all, I can’t seem to find anything more than a highly generic snippet of code or a coerced continuation.
This is a sparse matrix library, IIRC. Numerical linear algebra and applications using it are black art at this point. I have written a Boundary Element Method evaluator for my Ph.D., and know what it entails to work with these things.
Doing fast operations on sparse matrices is a cutthroat race and when you can shave your hot path by seconds, your solution can save hours in some cases. So, it's an interesting niche. i.e.: It's no ordinary boilerplate, and worthy of publications in academia.
While I worked with dense matrices; the effect, difficulty, blood sweat and tears are still there.
When a model can give back your hard work back to you with a "completion" without attribution, that's bad.
Edit: Somebody just posted this below [1]. Added here so it doesn't get lost as the discussion grows bigger.
These algorithms' design starts on paper, as pure maths. You get the analytic form, and convert this to numerical/discrete form and start to design from there.
You need to add normalization, subnormal number prevention, maybe some architecture specific optimization if you are targeting a specific CPU generation, etc. Then it gets optimized further as you run tests, profile the code and run your test cases.
So, no two BLAS package looks the same, because they make different trade-offs, have different programming models, and handle things differently, at different points. Even more so, a newer generation processor with much higher FPU performance can have lower performance than previous generation, so you implement another copy of that function or add to detect that processor and have different paths just for that one.
IOW, when doing numerical maths on processors, esp. if you're doing this on many machines with MPI or multiple cores with hand rolled code or OpenMP, there's no single way. Maybe a best way for the specific CPU or cluster topology you have, but it still depends on the trade-offs and design choices you made in the very beginning.
The design of those macros is more art than science.
He basically said, "I know, there's nothing I can do."
You’re disqualifying any example that people may provide preemptively. No wonder you’ve missed them.
By “forced continuation” I mean the type of example that was popular for a while where someone would feed a lot of text into LLMs and then ask it to continue the text, then be surprised when it some times predicted the next tokens identical to the original example.
Do this enough times and you can find “examples” that prove your point, but it’s highly automatable so people were using it like a million monkeys at a million typewriters.
They know you can't enforce it as it will cost you a lot more money to do that than it takes to recover the damages.
So to them, it is just cheaper to clone it using an LLM and close source it down. Unless you have a lot of money for litigation, the economics of free and open source software with its licenses do not work with LLMs bypassing it at every single angle.
A book with a different plot? That would be obviously unrelated to the comment you're replying to?
I think there’s a lot of nuance and caveats to that kind of claim, assuming I am representing them correctly, but it’s a valid stance and I see where they’re coming from.
If we’ve mapped all of English, there are still ways to construct stories that haven’t been told from the mapping. The most simple would be a subtraction of all objects minus all objects that have ever been used as a murder weapon. Leaving you with a list of never before used objects at your disposal.
There are also probably close vectors conceptually but not in semantic use. Or trying to interpolate or extrapolate what exists in voids of space. Turning up the temperature and adding random generation of words. There’s tons of ways to tune these things to be more creative than regurgitative.
It’s interesting because these developments are actually an argument for making closed source software moving forward if you’re hand-crafting it make it the most restrictive license possible and don’t show the sources.
But I don’t agree with the OP everything should be open sourced. For instance, there’s a difference between deliberately steered AI work and something completely vibed. The former takes deliberation and creative choice, the latter will spit out fragments of prior art.
It’s the same with all generative work. Using diffusion models with controlNet (or equivalent) I can pass in a sketch wholly from my line drawings, and ask it to paint for me. That’s my design, assisted by AI, and should be completely copyright by me.
Coding agents will do the same thing when given sufficiently unique inputs. So, the claim all should be open sourced by default is flawed.
At this point, LLMs can just parse the machine code in your binary.
By doing closed source you are making it harder for the good guys (humans trying to learn sth or contribute) but not for the bad guys (LLMs getting trained or otherwise reading the code).
But you’re right, the fact is we simply live in a different world today and it’s tough to say what is the path forward.
But it’s harder to justify giving to the public when companies are making money on our work. It’s not a good situation for creators across the board unless motivations are purely altruistic.
It didn't protect you. It only protects corporations rich enough to get enforce their IP.
At this point it is better that it goes away.
There was a case about this specific issue, and in order to protect billionaires from coders they effectively declared AI models "natural persons". 50+ times in the copyright act you will find only natural persons can originate copyright.
https://www.courthousenews.com/coders-lose-appeal-in-copyrig...
To give the money to billionaire corporations courts ruled DIRECTLY against established law. How much do you want to bet that when it comes to protecting ChatGPT AGAINST OpenAI, when it comes to protect Claude against Anthropic, courts will immediately do a 180 and declare them programs again?
If you look at past cases, it gets much worse. In order to justify a conviction against libraries using DRM to enforce lending, and because old licenses of course have zero language about digital copies, courts were willing to state that making a copy for fair use is not allowed if there is the mere potential for damage to the authors, as judged by the authors EVEN IF THE LICENSE EXPLICITLY ALLOWS IT. Of course, applying this to the above court case, there is no possible defense for OpenAI, after all, by that standard, the open source license doesn't even matter! That's how the law works for billionnaires. Outlawing DRM based lending has destroyed library access to an incredible amount of old works, and effectively denied access to old movies to Americans (because maintaining enough working physical copies over a large area is impossible). Whatever excuse gets the money to the billionaires!
There are many other totally absurd court judgements. For example, in order to get convictions where people didn't re-upload they had to judge that copies in buffers are also "distribution". NOT for billionaire telco's of course. Only the ones in your house. So courts judged that sending from your modem to your computer is distribution but sending over 1000 routers from Los Angeles to Athens is not! WHATEVER protects the billionaires.
As for this court case, obviously it is trivial to make a ML model that just outputs what it gets as input. Make a byte transformer, and just have diagonal matrices as layers. Boom! Done. You can also make it somewhat smarter. Let's make it copy, but make snow white a 220 pound black dude. There is a severe lack of color in old Disney movies anyway! You know, so there is no argument about transformation.
This obviously transforms its input. It's in the name. It's the EXACT same thing as ChatGPT, which according to courts originates copyright. Now run the Disney movies through it, and they'll be byte-identical BUT transformed to the input.
How much do you want to bet they'll still rule the money goes to Disney? Microsoft? So you can bet your left testicle courts will judge for selective copyright enforcement. Finding some excuse so the money keeps flowing to billionaire corporations, that's all courts do.
People in this thread are acting like the AI companies are just flouting the law and there's nothing that can be done. This is an extremely well documented precedent, and GPL violations routinely show up in court. It's a very easy case to lay out especially because no one is really complaining about money except in the settlement... It's all about distributing the source code. And of course a very nice chunk of change for infringement but that's beside the point.
A successfully litigated case would result in the open sourcing of every AI that touched agpl code in any way because it was in memory with the AI algorithm.
clear in what way?
I think that’s why so many of us get so angry when people just dismiss the theft claim. They either lack imagination or experience. We can debate it and that is valid, but to dismiss it out of hand is not right
It also feels like a very discouraging time to release anything that you put a ton of effort just to get someone in minutes to steal your authorship and leave you as if you actually didn't do anything at all? Am I wrong?
If you don't want your code copied, then don't open source it. If it bothers you that others are going to look at and "get inspired by", "make derivatives of", "copy", "fork", etc then you shouldn't be putting it out in the open.
You still have to give the source back and attribution has still to be maintained of its original authors, regardless if is a fork, a derivation or whatever you want to call it.
There are situations where none of these clauses have been complied nor its violators faced any legal consequences. That's what I'm talking about.
Now on top of that you can basically instruct and LLM to generate variations of what someone released and cover that up under the excuse that is a different project when is actually not.
Because it has been generated by a computer then we go into muddy waters about if the code generated is to be considered stolen or not.
Edit: Effectively what LLMs produce is authorship and attribution dilution.
because I am not releasing it into public domain, but under license that requires (for example) attribution or releasing derivative work under the same license
People who care about being respected on the most basic level are not going to stick around in a community that disrespects them. I'm not the person you were responding to, but I am mad because the social contract (not to mention the legal contract) of open source has basically been destroyed, and a lot of people have poured a large portion of their life into that community based in part on the assumption of that contract being upheld. Imagine a social contract that is important to you being violated to such a degree that you cannot go back to that society.
Don't worry; the "developers" who generated your code will get their own law back when they find out it's almost impossible to monetise their theft.
I'm frequently amused by the number of "developers" on HN who claim that they poured weeks or months of effort into some product, and that they are the differentiating factor, but can't see that their weeks of effort can be cloned in a few prompts once they release.
I think they just want to be able to take whatever they want without consequence, so it's convenient for them to define it as being different from theft
I know software patents, the worst idea in IP, do exist, but I think they're as toxically bad an idea now as they were decades before AI, when they were first invented.
You shouldn't be able to own an overall implementation idea. If you can, then Microsoft, Oracle, or Meta can too, and can start suing everyone for 'ripping off' an idea that they happened to come up with first. In that world, you'd have to consult a copyright-police AI (ironically) after every function you write, to scan it for ideas someone else has claimed. "Sorry, the function PadStringL() in this JavaScript is too similar in implementation to str_lpad(), from an AGPL library for perl that was released in 1998."
Reads like a non-ironic version of Malus: https://malus.sh/
So Harry Potter?
Thaler v. Perlmutter (again simplified) showed 100% AI output can't be given any copyright.
The directions the current cases are going are very much opposed to that idea and I wouldn't expect things to change in the opposite direction.
It's important to remember that the purpose of the license is to allow the copyright owner to exercise their rights in a manner they deem fit. Even if they choose to give the code away, that choice is captured in the form of a specifically worded license (MIT, BSD, etc.).
This means that licenses exist because code is copyrightable in the first place, with the license governing the use of said copyright. If AI code is not copyrightable, then no license can govern it.
Just as it's important to remember that the purpose of regulations like copyright and patents are to promote the progress of science and the useful arts.
We're not locked in to a suicide pact with what the Founding Fathers decided back in the late 1700s. Congress can decide that all LLM-generated code is automatically covered by -say- the GPLv3, even if no one holds the copyright to it.
If the absence of a particular person to hold the copyright twists your knickers, you could go a bit further and -say- decide that the people of the United States collectively hold the copyright to all LLM-generated code that's generated by US people or entities, and that relicensing of a particular piece of LLM-generated code must be agreed to by every US citizen that was alive when that code was created.
“Open sourcing” is not just a legal state, it’s an affirmative act that takes work to prepare the codebase for public consumption. Saying that all the weird business code in the world should be involuntarily publicized is an incoherent concept. What precisely would OP expect to happen in a world that adhered to their opinion? Because to be clear, 90%+ of all code being written today is LLM-generated, so OP suggests that companies should no longer have any privacy wrt their internal software, all LLM code just gets yeeted into the public. How could that possibly work?
Given how easy it is to write software now, this perspective seems to overindex on a past state of the world that no longer applies.
This opinion by OP also assumes that code itself has some form of value. With the ways LLM work now code by itself is nigh-on worthless and as the models are becoming more capable, the value of code keeps going down.
Here's where I can get on board. I think people should be putting AI to work to improve everyone's lives for free. Your version of "should" is like "we should make this a law." My version of "should" is more like a moral recommendation -- we should be using as much of our subscriptions as possible to benefit everyone instead of enriching a handful of people. I view it as a natural extension of the spirit of free software to begin with. Software should be free (as in freedom), and we finally have enough development power to make real headway on that.
Just because AI was involved doesn’t mean significant human thought and effort didn’t go into the production of those artifacts.
My agentic software development loop requires heavy involvement of real-world feedback. The ratio is huge. 20 mins of agentic software coding against hours or days of testing, trying it out, real-world contact, thinking about what feature is next or what tweak would make it more usable, smooth, intuitive. That feedback is baked into the product. Forcing it to be open source steals all that time and effort for me, and takes from me the decision as to how and whether to open-source it. So you mean the code that I’ve agentically written to help manage my private financial affairs (on local models, for privacy) or my kids’ complicated school schedules must now be open sourced?
My manners begin to fail, so I’ll stop here.
I don't understand this view point. Using ai and making high quality stuff is not pushing a button. Its hard. It takes real effort and diligence. And you have to pay actual money out of pocket to deliver it.
Let us skip the whole Bell Labs C/C++/unix/sh/ksh -> BSD csh/vi/bsd/tcp/ip, and other proprietary unix variants/utils and focus instead on today's landscape.
There are two axes we can partition the whole ecosystem. Free/OpenBSD, Clang/LLVM, musl, busybox, X11/Xlib, sqlite, postgresql, nginx, Python, Go, Rust, many embedded rtos, vendor sdk, utilities etc.. and then there is Linux/GCC/glibc, etc. Along the licensing spectrum there is GPL and then the rest of the permissive licenses MIT/BSD/Apache etc where source code publishing is not a requirement.
These permissive license offerings are more prevalent compared to the GPL offerings and as such one can gain all the knowledge needed to build a fully functional system. LLM could memorize, or copy the pattern, so even though it is not a clean room, courts seem to be ok as long as things are not spit out verbatim.
Add to this, the fact the there are tons of research articles, user manuals, RFCs, so one can learn and understand how to build the needed reusable component if small and give their own prompt (and bugs) and and let LLM do as user described.
In the US, purely AI-generated code isn’t copyrightable, but it also doesn’t mean you have to publish it. Also, putting an open-source license on code nobody holds a copyright to has no legal effect. So, ethically or otherwise, there is no strong and convincing argument that open sourcing is the right thing to do.
What 'creators' could do is to compile a list of all the frequently used permissive licenses that are applicable to their system and just make it part of their software license attribution.
[1] https://redmonk.com/sogrady/2026/03/25/open-source-licensing...
I have my suspicions that the AI companies have been using reverse engineering to gain more training data.
Ethics don't really concern these companies so...
When you have essentially infinite compute and are constantly looking for more training data. To me the next logical step is to start reversing compiled programs.
It could also explain why these AI models are so good at it too...
How do you copyright stolen material?
Much like how a photographer 'just' clicks a button on a machine and through a very complicated process it creates media, so does the human who makes media via an AI machine.
I think because of how corporate power works and how much money is at stake this will end up as the end result. Laws are made up by humans and a majority vote in a parliament can set this to be so, previous rulings be damned. And most treaties never really ever think about how media was made because this was never an question until recently. Copyright are not constitutional rights in most counties.
It certainly doesn’t seem to be about practical solutions. It doesn’t even touch on the ramifications of its suggestions. I’m pretty sure that it would be a massive boon to data center operators and cause most of the readers of hacker news to lose our livelihoods.
There's a lot of room in between code that is closed-source and code that is "copyrightable".
Should code crafted via cut-and-paste from StackOverflow be open source? How about newsgroups before that? What about apps that use "no code" tooling? Is there a threshold for the use of external libraries and packages that cross the threshold for "that code was simply scraped from the internet and used without permission or proper attribution"? How about code I wrote while using auto-complete a lot?
I appreciate the author's sentiment and recognize that LLMs have aggregated the work of many, many people. I'm guessing their work wasn't wholly original either, like so much of the code I wrote before the age of LLMs. Whether those people whose work has been aggregated to train LLMs own that work - those ideas, those thoughts, those strategies - is exceedingly complex and (I speculate) largely won't hold up to real scrutiny.
But thats also why its buggy.
As soon as I start refining it, and commanding the AI to fix the mistakes, this argument starts to lose ground fast.
The tech community has adopted open standards for as long as I've been alive, and the AI is using these open standards as much as it is actual code.
Perhaps an open standard to prevent code from being used as training ( it probably already exists, i dunno ).
Methods to detect it ( I've seen that showing up recently. Using AI to detect AI. )
Some sanctioned actionable penalty under provable circumstance as the resolution ?
You can see why the copyright office wants to treat this as any other thing.
The details of proving claims get complicated quickly.
If I write a space opera that is a LOT like Star Wars there are major legal implications to this. If I write an original work of science fiction involving a weapon that destroys planets as an allegory to the history of the atomic bomb, I’m probably in the clear even if one of the characters is a furry alien with a laser sword.
The challenge now is how to apply that framework when nobody can see the original or resulting code.
Quitting and relaunching Safari, then returning to the site, produces the same results. The process for this website is what is using the RAM, it persists after closing the tab, and needs to be force quit.
Point 2: Correct me if wrong but can AI generated code actually be copyrighted? If someone just keeps prompting but not touching the code would this still be considered pure AI generated work? If this is the case then point 1 and point 2 basically means AI generated code is already open source in effect if not in name.
This idea of no libraries/external dependencies sounds extreme, until you got hacked by a tiny library for http calls and that cost you billions of losses.
And then again, I wonder which license should be used. Is this a case of copyleft, and therefore everything generated should be something like GPL, or is it more like public domain because no copyright can be exercised?
As an example, I have developed a set of grounding guidance for my AI models at my work. The specific grammar and vocabulary belong to my employer. But I also have a clean-room version of it that completely strips out that proprietary infringing information while still retaining a similar semantic structure. That will be posted next month on my GitHub under a GPL-3 license like I do with my other non-infringing AI-assisted work.
In other words, almost nothing is closed source to LLMs if they have access to the binary.
A person's contribution here is difficult to measure. This statement reminds me of one of my older bosses who priced software per lines written.
An AI-generated software's quality reflects the author's vision, taste, and expertise (if any). These are there regardless of the number of lines reviewed.
I would've supported open source for completely AI-generated apps including the conception of the idea.
RMS would be proud with this post though.
I think that's the actual point here. AI-generated code shouldn't necessarily be open source, but it is not (or should not be) copyrighted. You can still keep it as a trade secret, but you have no legal protections that prevent others from reusing it once they have access to it.
This is a chance for great good for humanity and for the AI companies to do the right thing for themselves and for all of us.
Not releasing the code as open source would be just... well... evil.
And a further question arises for me: If we don't start sharing the fruits of the machines now, then when?
If you're curious, here's my newest open source which helps build Rust web services along with Axum: https://github.com/publicprojects-io/axa and you can see the LICENSE.md file.
The rest of the code will be open source, see how many open Wispr flow alternatives are there already, everyone has same features.
PLEASE stop right there. Nations are sovereign, they decide for themselves if/how far copyrights are enforced. Let's keep it that way. There's enough [800lb gorilla meddling in other's affairs] as it is.
This is a debate that we need to have before it gets event more muddier.
AI generated code should be (is?) public domain.
The real value ends up being found in software where there is a person behind it continuously refining it into something others will look at and say “Someone clearly paid attention to this.” Models can’t (yet) reproduce that because they can’t/don’t go interacting with users or asking bigger picture questions.
Whether someone is producing that software with a model or not doesn’t change much about the ownership picture to me: it’s the person that owns the project, and the LLM is a tool.
Once again, it all comes down to it being a tool and how it’s used, and there are no useful blanket statements that can be made about it (or how the tool’s output should be classified, legally or otherwise)
At least, the author should try to back up their demands with further justifications and make them less contradictory.
Looks like the author wants to abolish copyright in a very round-about way. They are saying that AI-generated code should be released under CC0 due to complexities around the status of software copyright in various jurisdictions.
But if the concept of copyright was abolished as a whole, then licences such as GPL would also lose their power. Some people say that's a negative thing, but I do not necessarily think so, because it achieves the stated goal of the GPL, software freedom (i.e. you don't need to be granted a licence to copy and modify things)
I too have trained on the massive corpus of open source code. Should everything I code also be open source? Or only if I leverage an artificial neural network as a prosthesis to enhance the capabilities of my natural neural network?
Joking of course. Not sure copywriting code ever survives the AI era.
Llms are the compiler, and there are skill levels with vibe coding.
by that logic, anyone who learned to code from open source projects should make their own code open source too.
You've figured out a way to eliminate money.
But yeah, aside from that, I’m also releasing all my Vibe Coding games under the MIT license: https://github.com/retrogames23/
I don’t really see a problem with LLMs slurping up and regurgitating the world’s knowledge, if it was all freely and equitably available, and more importantly had been beforehand. We’d all herald it as an incredible innovation. And in some ways it is even now, because I do have access to it in numerous forms.
The problem is that some author’s livelihood is adversely impacted by this, as copyright is (in a sense) what ensured their remuneration for the original work. So LLMs undermine the existing social and financial order in deleterious ways. It’s the same thing we’ve seen play out in mathematics, a bunch if tech bros show up with a powerful tool, use it in a brash manner that likely causes real harm, then worse, start pulling up the ladder when big media conglomerates complain.
I suspect we’ll soon be in a situation where we no longer have easy access to unfiltered LLM outputs. If your OSS project was in the training corpus it will still retrieve it. It will not, however, retrieve content from NYT or other protected sources. The end result is that small-scale, solo creators are damaged, and large-scale creators are still afforded copyright protection.
There is no way to enforce opennness. The LLM gives me output, I iterate on it by hand and with other language models, who does it belong to now? We are ushering in a post scarcity world for a select few.
No one goes to an LLM and says, 'Make code'. More often than not (and with exceptions) there's a very specific problem getting solved. The distinction between human 'effort' (whatever that means) and Ai effort (??) is more or less arbitrary... Infact, it's almost xenophobic and snooty. Pre-Ai humans had other humans build something like x but with y specific features. If it wasn't a problem then, it's not a problem now just because people don't have to directly deal with another human. In the same vein, I think people are forgetting that sometimes projects are birthed by slapping together code (or an instruction for code) from all across the Internet.
So really... What even is 'purely Ai generated' code? Nothing comes from nothingness and generally I'd prefer the purest expression of my ideas be protected regardless of who wrote it... Human4hire or Chat.
EDIT: This article is unnecessarily upsetting. I don't even understand the problem when at the end of the day. A shit ton of the value accrues to all of us... humans! Not even the companies (atleast not so far). If Artificial Intelligence really is a utility, like electricity, then wtf is exactly the problem? I hope nobody really gives any real thoughts to policing Ai usage... It'd be as unreasonable as policing a calculator or pen and paper.
Manners force me to stop here.
Whether programs written by LLMs should be protected by copyright law is also an entirely different question than should the authors be legally required to release the source code under a specific kind of license.
It cited Naruto v Slater, which unsuccessfully argued that the copyright for a monkey's selfie belong to the monkey, not to the owner of photography equipment.
The courts dismissed the case as animals cannot hold copyright.
---
While the courts did not rule it, the apparent copyright holder is the photographer Slater who received royalties.
This is directly analogous to AI code, in which a human did not directly author the characters but regardless had "significant creative contributions."
The AI machine just went out and read a bunch of examples then adapted them, which is what lots of programmers do.
The argument between open and closed source has little value anymore and will soon not even make sense to discuss. It will be like writing "2 + 2" and arguing over whether my "closed source" copy of "2 + 2" vs your "open source" copy of "2 + 2". When something is trivial to reproduce it becomes absurd to argue over who owns it.
I don't particularly care about copyright or whatever ethical arguments yo may come up with -- I write code mostly for money, as do my competitors -- if you can figure out a way to stop them from using AI, I'm fine with not using it either. I'm fairly skeptical you can close Pandora's box though.
That aside, we may see more software going in a source-available direction -- either that or full cloud. Up until now being closed source was a competitive advantage, but now it's trivial to clone even fairly huge software suites, so that's less of a factor.
Having the source may also become a bigger advantage for regular users than before -- given they can now vibecode extensions/plugins, or customize the software more than what a config would personally allow. this probably wings the calculus away from a Photoshop-style license, and closer an Unreal Engine-style license.
Either that; or everything goes full cloud of course.
That is everything bar one own mind and body, I guess, but your lineage might vary, and for sure some people out there would rather be deemed owner of everything under the sun, starting with human corps and souls.
Until and unless every creator and contributor of every piece of training data consumed by these models is fairly compensated for the use of their works, then absolutely everything created by these models should be 100% open source - including the models themselves.
This means that all AI generated code is public domain at the point of it being generated.
Of course just because something is public domain that doesnt mean you have to release the code publicly. Public domain just affects what others can do with the output. It doesnt mean you have to release the code yourself.
The new Epic Games Store is apparently entirely vibe coded. So that technically would mean that the source code for it would be public domain right? But people still can't copy the store or do whatever they want as you have trademarks protecting it. And Epic is under no obligation to release the code..
I am not a lawyer. It's possible I am completely misunderstanding the situation. Is there something I am getting wrong?
This is definitely not true.
The only thing a court has ruled is that the AI itself cannot hold any copyrights. Not that there are none or that using LLM based tools removes all copyright.
Strong argument, but the case that such a strong transformation should maintain the original licence only applies to my knowledge to GPL, which consists of a very small portion of the training set. Creative Commons would not even require the source code to be distributed, just attribution, which may already be the case by the nature of the models.
>"The second reason is legal: purely AI-generated code is not written by a human, meaning it should not be copyrightable. The foundation for this principle in the US goes back to the famous Monkey Selfie dispute, which established that non-humans cannot hold copyrights."
But no one claims that the AI holds the copyright, unlike Greenpeace which claimed that Naruto the monkey held the copyright.
Yes, it was trained on free software. Why does that mean my privacy should be invaded now if I distribute binaries I made?
But we're not headed in that direction are we.
1. Software had a strong movement of freely sharing all code because they believed this technology was too important to be controlled by corporations.
2. AI companies managed to create millions of RL environments from GitHub PR’s and similar, and train their model to learn what it means to code from all the human labour in the world from the past 30 or so years.
3. Companies now use these closed source AI models, to automate and fire their human workers who enabled this.
Something has gone seriously wrong here, whether this falls under copyright or not is besides the point.
We weaponized a fundamentally good instinct that generated a lot of value for society and allowed corporations to rent seek on all the data these humans generated to help other humans not trillion dollar corporations.
“Well we’ll give them a UBI check”, the AI company says which is a complete non-sequitur. It’s not about the money, most of us have saved enough.
The only solution that sounds good to me, is a model trained on Open Source Data must be Open Source and all the code it generates must also be open source. This is the only way to stop the coming rent seeking. Even mathematicians will be happy with this change!
> It’s not about the money, most of us have saved enough.
This is incredibly detached from reality. Most software engineers care more about money than they do about abstract notions of software from. Most certainly have not saved enough.
In fact I'd argue that free software and open source is economically dead and unsustainable because of AI generated code and almost no one wants to pay for their tools because an AI can generate the missing feature for them close to $0.
Maintaining it is another thing, but assuming that the cost of tokens get cheaper, why wait for open source developers to maintain it when a frontier AI model can do it for far cheaper and quicker?
I am just saying what the average manager turned vibe coder would say who will refuse to donate or pay for established open source projects that they use for free.
the only merit or such claim is to maybe move the overton window a tiny bit. maybe that’s worth the blog post
AI comes along and now grandma, who was formerly a midwife and teenager from home can start bending aluminum and carving wood with their words through AI. There are a bunch of open ships and satellites in the market, but Grandma is using her midwifing skills to ask AI to bend a new tool for her that helps turn breach babies around without requiring a c-section. No open source breach tools or medical tools on the market Grandma just needs aluminum and wood combination she would never be able to achieve without AI. She hammers down a lot - sending 1000 follow-up prompts to make the AI do stuff nobody has done before. Next her grandson decided to combine tungsten and wood to make a new toy that helps kids go airborne and land safely every time - like an egg-drop but for real life people. No open source code for that out there - he used the AI which knew the properties and the languages needed to get his idea to work. He hammers the AI with follow up questions and edits a bunch of the code where the AI defaults to the wrong setup, by trained convention. But he succeede. By this plan should they be allowed to copyright their work? Should their work be automatically open source so they can never monetize it either?
Until then, I’m sorry, but I have to feed my family while we all navigate this goddamn global transformation process.
I keep seeing posts like this (especially on reddit) that infer some people are still writing code by hand and its confusing.
First of all, nobody must force OpenSource. Period. Second, such exterme views spawn extreme views in the opposite side.
Discussion is good, but this article is too draconian to be practical.