- Ask it to update the skill to warn it against making that mistake again
I think that, using that iterative process, I end up with something better than just asking it to perform the task plainly
One observation: ask an LLM to write a skill, it tends to make them overly verbose and prescriptive. Often, something briefer and human-written actually works better
Another: I generally let the LLM propose edits to the skill, but I review them carefully and often modify them, because I find it has a tendency to solve the current problem at the price of worsening the solution to a previous one
> - Ask it to update the skill to warn it against making that mistake again
Yep! I have a canned prompt that basically boils down to "scroll up, read through and give me the top `n` things that were difficult..." and more often than not a small skill or change to `agents.md` comes out of that.
Oh, skills are absolutely useful for giving the LLM distilled knowledge of things that it doesn't just know ("off the top of its head" so to speak). For example, a company's coding style guide is something that could be very useful to express as a skill.
They are useful for packaging all the related bits together. Some instructions on the line to add to the main prompt, detailed policy doc that spells out details, troubleshooting docs, the code itself, etc.
One question I have about stuff like this: How does it affect the models intelligence or thinking ability. If this modifies the output or chain of thought in any way, it may impact what the model is capable of right? Especially if it's not trained to use this kind of language during training.
I took one of the examples ("Leveraging sqlpipe's robust...") and just prefixed it with this:
> Rewrite this using ASD-STE100 simplified technical English:
And you get a good-enough result, it seems? Maybe add another sentence or two for guidance, but what's with needing these giant skills, when ASD-STE100 was surely in the training material?
I certainly get what makes you feel that the model should have been wise enough to utilize the knowledge in its pretraining, but it seems like the pretraining data gets pretty muddled in later stages.
Does this actually work for you? I've tried adding rules in my user profile as well as adding instruction in my CLAUDE.md but my models always eventually go off the rails and start spewing technical jargon in doc strings & descriptions.
At this point I'd do anything to get claude to dumb down and simplify it's explanations in my code, so I'm looking forward to giving this a try and seeing how it goes.
It’s ironic that the README has all the tells of being LLM-written:
> 53 numbered rules, 9 sections, written in 1983 by people whose readers die when a sentence is ambiguous. The ones doing the heavy lifting: …
Not really a promising tell for a writing skill, IMO.
The problem with at least ChatGPT is no matter what personality you set it still reads like a smug asshole trying to sound smart. You can just pick different flavors of smug asshole.
How is that ambiguous? The best interpretation I can find where "test" is a verb is an elision: Test [that] B is an alternative to test A. That is an unlikely reading: "test" is a verb in the first instance and a noun in the second, breaking parallelism. And it's just a very unlikely thing to direct someone to do.
the problem I’ve found with these things is that models drift immediately.
if it’s not a git commit hook that runs over docs and comments and commit messages objectively it’s probably useless.
which I might try.
Claude is so friggin wordy and has no idea how place comments iff they actually matter.
Ironically?, you're not allowed to copy from the pdf (yes, trivially defeatable - but why).
I guess we'd need a linter (ruff, but for English) that gates whether you're using any non-ASD-STE100 word? Otherwise, yeah, any agent will almost certainly forget this (one line) instruction.
This video benchmarks slop-style indicators with different skill/prompt solutions including the STE skill vs. George Orwell's six rules of writing prompt: Orwell came out on top overall.
Additional bonus: it doesn't add much more tokens to input context. I have compared prose prompts with these rules and without and I am liking the results.
1. Never use a metaphor, simile, or other figure of speech which you are used to seeing in print.
2. Never use a long word where a short one will do.
3. If it is possible to cut a word out, always cut it out.
4. Never use the passive where you can use the active.
5. Never use a foreign phrase, a scientific word, or a jargon word if you can think of an everyday English equivalent.
6. Break any of these rules sooner than say anything outright barbarous.
Cruft complaints aside, what are people actually doing about this? Claude's prose output is becoming incomprehensible as its coding skill increases, and the concepts it needs to express are becoming more complex as it can handle more complex tasks.
The actual STE standard would score horrendously in a college essay. STE encourages simplification and tons of repetition of words that is discouraged by college professors. It is designed to be clear technical writing for people with a loose grasp of English. College writing encourages complex sentence structure, varied word choice for the same concept and other things that make the writing more interesting at the expense of clarity.
I don't understand the challenges involved super well but I feel like this might be better as a piece of actual code (like a linter) that you can run to have an LLM iteratively de-slop its own writing, rather than forcing it out of distribution and having to contend with all the unreliability that entails.
I've added the prompt to use the ASD English, on my CLAUDE.md when I learnt of the standard. The generated output is more tolerable to read, and is less confusing.
I like it, and I'll also try the Economist one on another thread here. I have global instructions on how Claude should try to write things like I do.
I generally avoid having lots of skills, security risk as I won't vet them all.
Nothing is more comical than AI Slope declaring that I kill AI slop:
> your AI writes like a LinkedIn post. make it write like a Boeing manual.
> An agent skill that forces LLMs to write docs in ASD-STE100 Simplified Technical English:
the controlled language aerospace has used since 1983 so a tired mechanic cannot misread an instruction.
AI slop dies as a side effect.
The day I have to negotiate and persuade the machine to stop talking shit rather than command it is the day I decide fuck it and go and farm geese or something.
Smells like today. I’ll take goose shit over this.
Recent-ish models learned to use the same trick engineers played on non-engineers, where they try to sound very smart by overcomplicating very simple concepts.
It's very taxing, especially since these are usually multi-paragraph texts. I noticed I've started doing a lot of "hey, you're talking gibberish again" a lot with 5.6 Sol.
Both. Command the author to use the style, then command a reviewer to check it. Write one skill called review-prose with your rules, and another called write prose which tells the author they will be judged by review-prose, so you only write the rules once.
What I have found is that getting a model to rewrite a badly written passage is hard, because it seems to key off what it reads. It might swap some vocabulary around ok, but it doesn't fix structures very well. So getting it close to the preferred style in the first place is better.
To take this further, if you must fix existing bad prose, write a clean-prose skill which extracts the bare structure of the prose with none of the style, hands it to an author subagent who isn't poisoned with the original bad prose, then hands the output to a reviewer subagent.
Opus 5 writing is horrendous, so I have been experimenting with improving the output!
It would be nice if people were indeed doing things.
However, asking Claude to write a skill encoding ASD-STE100 after seeing it pop-up in your social feed is not doing much at all. It's certainly not worth a post on HN.
Having said that, this skill might have been the seed for the flurry of low-effort posts on the subject on various platforms this week. If that's the case, I take back the majority of my scorn.
You'll have to excuse me for becoming jaded by the diminishing levels of visible effort put into projects and products shared on here.
Based on what? I wouldn’t have learned about ASD-STE100 if I hadn’t stumbled upon this post. I’m not even going to use the linked GitHub project, just mentioning ASD-STE100 spec in certain prompts makes them useful.
Since your claim that adhering to a proven style guide is useless slop is not itself useless slop, I am looking forward to your empirical evidence or formal proof that there is no benefit to using it.
[1] https://knowyourmeme.com/memes/thinking-quickly-dave-constru...
- Create a skill to perform some common task
- Watch the agent use it
- Wait until the agent makes a mistake
- Ask it to update the skill to warn it against making that mistake again
I think that, using that iterative process, I end up with something better than just asking it to perform the task plainly
One observation: ask an LLM to write a skill, it tends to make them overly verbose and prescriptive. Often, something briefer and human-written actually works better
Another: I generally let the LLM propose edits to the skill, but I review them carefully and often modify them, because I find it has a tendency to solve the current problem at the price of worsening the solution to a previous one
Yep! I have a canned prompt that basically boils down to "scroll up, read through and give me the top `n` things that were difficult..." and more often than not a small skill or change to `agents.md` comes out of that.
> Rewrite this using ASD-STE100 simplified technical English:
And you get a good-enough result, it seems? Maybe add another sentence or two for guidance, but what's with needing these giant skills, when ASD-STE100 was surely in the training material?
Tends to produce relatively well structured prose that’s easy to edit.
“Output tokens are precious, be succinct in your responses. Use ASD-STE100 simplified technical english”
At this point I'd do anything to get claude to dumb down and simplify it's explanations in my code, so I'm looking forward to giving this a try and seeing how it goes.
https://en.wikipedia.org/wiki/Simplified_Technical_English#M...
Not really a promising tell for a writing skill, IMO.
> Yes, this README breaks half of them. Marketing is explicitly out of STE scope. The skill knows that and stays in the docs.
> Where it refuses to go: marketing copy, blog voice, brand writing. Flat on purpose.
(Each sentence there has an emoji that HN cuts out)
But did lead to me finding https://vale.sh and its various available linters. Might give that a try.
> "Test" is an approved noun, but not an approved verb.
> STE: Test B is an alternative to test A.
So much for clear - unless you know the STE specific rule, the sentence is unambiguously ambiguous.
Direct access btw since the official site gates downloads with a Google form: https://www.asd-ste100.org/assets/files/ASD-STE100_ISSUE9.pd...
If you want to take things further you can use linters to enforce the whatever style you want, but just naming it is a good start.
Claude is so friggin wordy and has no idea how place comments iff they actually matter.
I heard about it from a friend, and posted its "spec" here a few days ago:
https://asd-web-be-prod.azurewebsites.net/media/wunhmi5y/asd...
Ironically?, you're not allowed to copy from the pdf (yes, trivially defeatable - but why).
I guess we'd need a linter (ruff, but for English) that gates whether you're using any non-ASD-STE100 word? Otherwise, yeah, any agent will almost certainly forget this (one line) instruction.
https://x.com/geogristle/status/2078492579511906771
This video benchmarks slop-style indicators with different skill/prompt solutions including the STE skill vs. George Orwell's six rules of writing prompt: Orwell came out on top overall.
Additional bonus: it doesn't add much more tokens to input context. I have compared prose prompts with these rules and without and I am liking the results.
Oh lord.
Pick one.
"Agent Skill to Enforce ASD-STE100 Simplified Technical English in Documents"
> Before you start, make sure that your AWS credentials are correct. If they are not, S3 rejects the upload with a permission error.
Wouldn't it be better to write:
Before start, ensure AWS credentials are correct. Otherwise, S3 rejects uploads with permission error.
I like it, and I'll also try the Economist one on another thread here. I have global instructions on how Claude should try to write things like I do.
I generally avoid having lots of skills, security risk as I won't vet them all.
> your AI writes like a LinkedIn post. make it write like a Boeing manual.
> An agent skill that forces LLMs to write docs in ASD-STE100 Simplified Technical English: the controlled language aerospace has used since 1983 so a tired mechanic cannot misread an instruction. AI slop dies as a side effect.
AI slop doesn't die at all.
And I agree, maybe I should use this for my emails too
https://github.com/woosal1337/blog/tree/main/videos/ep01-the...
> AI slop dies as a side effect
> One folder, no dependencies, MIT.
Smells like today. I’ll take goose shit over this.
Ads-STE100: Simplified Technical English - https://news.ycombinator.com/item?id=49101215
ASD-STE100 Simplified Technical English for LLMs - https://news.ycombinator.com/item?id=49065956
ASD-STE100 Simplified Technical English [pdf] - https://news.ycombinator.com/item?id=49075687
Show HN: Claude Skill for ASD-STE100 – Simplified English - https://news.ycombinator.com/item?id=49108318
It's very taxing, especially since these are usually multi-paragraph texts. I noticed I've started doing a lot of "hey, you're talking gibberish again" a lot with 5.6 Sol.
I wonder if limiting them to a certain style like STE upfront would make them perform better/worse vs. applying the style after they’re done.
What I have found is that getting a model to rewrite a badly written passage is hard, because it seems to key off what it reads. It might swap some vocabulary around ok, but it doesn't fix structures very well. So getting it close to the preferred style in the first place is better.
To take this further, if you must fix existing bad prose, write a clean-prose skill which extracts the bare structure of the prose with none of the style, hands it to an author subagent who isn't poisoned with the original bad prose, then hands the output to a reviewer subagent.
Opus 5 writing is horrendous, so I have been experimenting with improving the output!
However, asking Claude to write a skill encoding ASD-STE100 after seeing it pop-up in your social feed is not doing much at all. It's certainly not worth a post on HN.
Having said that, this skill might have been the seed for the flurry of low-effort posts on the subject on various platforms this week. If that's the case, I take back the majority of my scorn.
You'll have to excuse me for becoming jaded by the diminishing levels of visible effort put into projects and products shared on here.
This is the first time I’m hearing about this, I think it’s nifty, and it’s precisely why I come to hackernews at least once a day.
Also what is wrong with using Claude to make a more polished post about something that’s being talked about already?