GrapheneOS imposes a set of restrictions on how generative AI can be used in our project and community. It isn't forbidden but rather we imposed rules based on actual issues.

Posts made in our forum, chat rooms, issue tracker and the rest of our project must be written by humans. There's an exception from this rule for translation and accessibility features. That means commit messages, pull request messages, bug reports and feature requests are expected to be written by humans, not a machine.

Replying to @⁨GrapheneOS@grapheneos.social⁩

We largely disallow making posts entirely based on AI model output. For example, we get a lot of forum threads from people with concerns based on AI model output and will typically provide a quick answer followed by locking the thread and then eventually removing it.

It isn't permitted to submit pull requests or issue reports created by an AI model without fully understanding it. It's fully allowed to file issues found by an AI model if there's a human who understands it and writes the report.

Replying to @⁨GrapheneOS@grapheneos.social⁩

We do not want issue reports entirely generated by an AI model or which were written by a human and passed through an AI model to provide analysis. It's usually incredibly inaccurate and we would greatly prefer the user's explanation of what's wrong. We want a description of what happened, a crash traceback if one is available and optionally a subset of logs emailed to logs@grapheneos.org if people are comfortable doing that after triggering the crash or another issue. We sometimes request it.

Replying to @⁨GrapheneOS@grapheneos.social⁩

It can sometimes be useful to analyze an issue with an AI model but it usually isn't. It also definitely isn't useful to do it with a free or cheap model available without either paying for it or running it on very expensive hardware. In general, users do not have access to anything useful to analyze it. We don't want people to keep converting their issue reports into slop. We want what a user pasted into the AI model interface rather than what an AI model produced as output from that.

Replying to @⁨GrapheneOS@grapheneos.social⁩

Frontier models are very good at finding bugs but it requires an experienced developer to babysit it and extract the useful portion of the output. Important bugs are often found but mixed in with a bunch of low quality output. The details on the issue and especially proposals to fix it are often wrong. It's still very useful and finds many real issues. The volume of real vulnerabilities being found this way in Linux, Chromium, Firefox, Postfix and countless other projects is quite scary.

Replying to @⁨GrapheneOS@grapheneos.social⁩

It isn't a good idea for people to point a model at an open source project and then start submitting bug reports to it. People need to be able to confirm the issues themselves with relatively high confidence before reporting it. It's okay to make some mistakes but it should not be the majority of what's reported. We do want people to report these kinds of security bugs to us but the signal to noise ratio is far too low right now. Even frontier models spew out contrived nonsense and fabrications.

Replying to @⁨GrapheneOS@grapheneos.social⁩

We want people to report very serious Android Open Source Project security bugs to us but we can't handle a lot of minor issues. We don't generally need Chromium security bugs reported to us because they handle those far more quickly and have a far better system for releasing it. Linux kernel security bug reports are useful if they refused to fix it (arm64 kASLR) or it didn't get backported to the LTS. GKI LTS being behind the LTS is a separate problem we'll be addressing ourselves again soon.

Replying to @⁨GrapheneOS@grapheneos.social⁩

We have high standards for code being merged into GrapheneOS, especially for code in critically important parts of the project. Most of the changes made to the OS are to critically important parts of the code. It takes a long time to get features to meet our standards. There's usually a lot of back and forth review with many improvements requirements for anything significant. External contributors shouldn't try to take on major features without talking to us and planning that out with us first.

Replying to @⁨GrapheneOS@grapheneos.social⁩

Going from having a working implementation of a feature to code we can merge often takes a long time. It can take months or even more than a year. It doesn't always work out. Sometimes we decide a feature ended up being too invasive or risky for other reasons and don't want to include it. We'll often do rewrites. Contributors need a full understanding of what they've submitted and need to be prepared to make substantial changes including fully rewriting it multiple times. AI slop isn't accepted.

Replying to @⁨GrapheneOS@grapheneos.social⁩

We don't forbid using AI models for writing code but pull requests largely created that way will typically be rejected or skipped due to not meeting our requirements. It needs to be well written code which appears to be regular code written by a human regardless of the level of AI assistance involved in making it. It should not look like AI generated code. We do want to know if AI models are being used and how they're being used rather than people using it but not telling us they're using it.

Replying to @⁨GrapheneOS@grapheneos.social⁩

GrapheneOS is based on projects heavily using AI including the Linux kernel. Cellebrite, NSO and other exploit developers are using it to exploit these projects. They currently have a major advantage thanks to AI which will likely be turned into a major disadvantage over the long term. It's getting a huge backlog of bugs fixed and creating enormous pressure to make systemic improvements.

Here's what Debian adopted, which is a similar idea but much more permissive:

debian.org/vote/2026/vote_002#

www.debian.org/vote/2026/vote_002#texte

Replying to @⁨GrapheneOS@grapheneos.social⁩

AI Concerns

@GrapheneOS
AI companies control what their bots do right? What if they tried to subtly place a vulnerability into graphene that your developers become too deskilled to notice? How do you know what is or isn't slop at that point? (We've seen nefarious PRs be accepted into the Linux kernel before AI, so humans cannot always be trusted to catch these types of vulnerabilities). I imagine the trust placed by the developers into these models only make this problem more of an issue.

- Who is the point of trust verifying slop from non-slop?
- Do you have extra security in place to test regressions imposed by AI models (that isn't an AI model itself)?
- What about the impending licencing issues? What if governments try to attack Graphene over illegally licenced code that was included from an AI model?

I think this is a bigger issue that needs more time to bake.

Replying to @⁨corigan01@todon.nl⁩

AI Concerns

@corigan01 @GrapheneOS musk tryed so so so hard to force its ai to not expose him as what he is, but again and again failed... — llm's need a uncomprehandable giant amount of data, it is possible to manipulatr it, to nudge it into a direvtion, play as a character... but the mass of the training-data will allways come through... to babysit a llm to make actually useable malicios code, so well written it wont be noticed needa a developer so good to babysit, they coud write it without.

Replying to @⁨l0gin@mastodon.social⁩

AI Concerns

@l0gin @GrapheneOS Hello I0gin,

Sorry I am not sure I fully understand your post? Are you saying that AI companies are unable to invite vulnerabilities into their model's output due to the large training set?

I don't believe these two things are equivalent. In the case of Grok (eww), they tried to convince it never slip up. It only took one occurrence of it messing up to invalidate the whole thing.

In this case, however, the one occurrence is all it needs to be a problem.

Replying to @⁨corigan01@todon.nl⁩

AI Concerns

@corigan01 @GrapheneOS they way generative text 2 text work is that they basically arrange letters, words, blocks of text after eachother so it looks correct compared what they are trained for right? : thats why ist so fragile, and the moment you ask a llm for something that isnt "standart" like for claude-code to use fish instead of bash, give valid syntax for a niche languague based on python but not really python, or ask to do something that seems "wrong" it will need experience

en