Hayley in the Stack (@hayleywitherell) header
Hayley in the Stack (@hayleywitherell) profile picture

Full-Stack Software Engineer | Dev at @FCPEuro | Founder of @nditcommunity | Volunteer at @codethedream | Alum of @turingschool | 👩‍💻

Denver, CO
Joined March 2010
Photo by Hayley in the Stack (@hayleywitherell)Photo by Hayley in the Stack (@hayleywitherell)Photo by Hayley in the Stack (@hayleywitherell)Photo by Hayley in the Stack (@hayleywitherell)Photo by Hayley in the Stack (@hayleywitherell)Photo by Hayley in the Stack (@hayleywitherell)Photo by Hayley in the Stack (@hayleywitherell)Photo by Hayley in the Stack (@hayleywitherell)Photo by Hayley in the Stack (@hayleywitherell)Photo by Hayley in the Stack (@hayleywitherell)
Hayley in the Stack retweeted
Is localhost down for everyone else?
139
204
24
2,494
56,349
Hayley in the Stack retweeted
BREAKING: production
16
105
7
1,216
31,245
Hayley in the Stack retweeted
Okaaaayyyyyy let me juuuuuuuust shaaaaaaaaaare my screeeeeeen.... okaycanyouseeit?
498
17,386
1,067
173,933
3,946,723
Hayley in the Stack retweeted
Nothing will ever match the feeling of building your first ugly HTML website and thinking you were basically a hacker.
21
34
8
282
3,950
Hayley in the Stack retweeted
BREAKING: Widespread outages are disrupting Microsoft Outlook, Teams and 365, with users reporting service issues across platforms.
153
394
98
4,045
950,952
Hayley in the Stack retweeted
We are tracking a breach of a 3rd-party JS host impacting hundreds of high value websites. This is staggering.
266
1,799
312
12,802
2,917,265
Hayley in the Stack retweeted
Got off a call with the an MS team lead who was on the bridge for this incident on what exactly happened in the outage: 1. This was a "latent bug" - a commit going in ~4 months ago to a Windows build, that only activated much later. Super hard to spot 2. Zero AI, this code was human written + committed 3. Machines got saturated and unreachable at a result 4. So many other things went wrong during this outage: a series of unlucky events 5. It was a dev who found the root cause, poking around and seeing a dump that reminded them of an error seen here. AI diagnostic tools were used and helped progress with the outage A detailed, public postmortem is on its way. MS wants to make sure they have everything patched globally before the postmortem. I'll add my two cents when it's out, and those details will be VERY educational
Madness - 12 hours into the outage. Microsoft is posting regular updates but they have not figured out what is causing servers to die when brought back online From their updates it sounds like it’s a thundering herd + some other weird issue they’ve yet to pinpoint
160
242
38
3,331
336,162
Hayley in the Stack retweeted
Marketing is the most important job right now. I said what I said.
102
77
21
676
18,964
Hayley in the Stack retweeted
Impressed. I’ve only seen one other system beat AI detection before and it was closed source. Source here github.com/EdisonScientific/…
We've developed a way to bootstrap post-training from positive examples alone and show it works on arithmetic, molecular structures, and scientific writing. We've used the method to train a 235B LLM for writing indistinguishable from human writing. 1/5
1
13
2
187
41,720
Hayley in the Stack retweeted
Blame still flows downhill. We just added a layer that can't be fired and doesn't know it did anything wrong.
3
37
9
408
13,920
Hayley in the Stack retweeted
"AI is a bubble." Maybe. The dot-com bubble was a bubble too. It burst in 2000. Trillions wiped out. Everyone who had called it a fad took a victory lap. Then the internet went on to eat every industry on the planet anyway. A bubble is a statement about stock prices. It says nothing about the technology. The prices can crash tomorrow and the model on your laptop will still write code, still read your contract, still teach your kid math. If you're waiting for the crash so things can go back to the way they were, you're going to wait for the rest of your life.
51
126
14
1,200
21,578
Hayley in the Stack retweeted
Replying to @ben_sage
Marketing is the new coding. In a time when anyone can make an app that looks great and functions well, the way you succeed is based on ability to market your brand.
1
5
Hayley in the Stack retweeted
hot take: nobody cares if your code is "handcrafted". users just want the app to not crash
65
16
4
283
6,150
New coders will never know the pain of pulling an all-nighter in school, solving a bug, only to find out it was just from a missing comma. 😭
1
1
34
Hayley in the Stack retweeted
So, what exactly is LLM writing? How is it different from how humans write? If you look at it closely, it's not just the groups of three, or "it's not X, it's Y"; it's the whole set of characteristics that usually go together. To study this, I used the same algorithm that Pangram uses to train its classifier. It's called "LLM twins." It works like this: I downloaded 200 samples of verifiably human writing across all genres, then asked a language model to create a short description of each, and then to fire up separate agents, which had to re-create the pieces from the descriptions alone and make them the same length as the originals. As a result, I obtained 200 pairs of pieces of writing, each pair sharing a genre, a length, and a rhetorical goal. For example, a human-written press release about a Boca Raton condominium hosting the filming of "Selling New York," and an LLM-written press release about the same event. Pangram generates millions of those. I only had 200, but that allowed me to measure the main differences between humans and LLMs. Here are the main differences: 1. LLMs rarely let two adjacent clauses or sentences share a noun. A human would write, "I stepped into a corridor. The corridor was dark and narrow." An LLM would say, "I stepped into a corridor. Dark. Narrow." 2. LLMs show much more diversity in vocabulary. A human would say "red" or "dark-red." An LLM would write "plum-coloured." 3. LLMs write fewer words per clause. A human would write, "We checked the reported numbers, our investigation found no discrepancies." An LLM would write, "We checked the numbers, no discrepancies found." 4. LLMs write shorter sentences. This is self-explanatory, I believe. 5. LLMs seem to avoid proper nouns (people, places) if they can. A human would write, "A distraught displaced woman, Hajiya Mairo Abdullahi, was at the weekend seen holding the picture of her seven-year-old child." An LLM would, among other things, omit the woman's name if it isn't needed for the narrative and doesn't recur later in the text. The LLM version would go something like: "A displaced woman, struggling with grief, was clutching a photograph of her seven-year-old child." Even if the person is named, an LLM is more likely to avoid using the name when attributing speech to them. A human would write, "Ms Abdullahi said," while an LLM would write, "The woman said." 6. LLMs also avoid repeated 3-word sequences, whereas humans are okay with them. A human would write "the Kenya cases"; an LLM would rephrase it as "cases from Kenya" or "the cases," or structure the sentence differently to avoid repetition. 7. LLMs operate in a narrower band of word frequencies: more often than humans, they avoid very common words (they are more likely to say "plum-coloured" instead of "red"), but they also avoid rare words (they are unlikely to say "incarnadine" instead of "red"). 8. LLMs use fewer numbers. This could be specific to news articles, but LLMs prefer to say "many," "several," or "thousands" when the exact number isn't essential beyond conveying the ballpark. A human would put an actual number. And finally, an aspect that captures the specific feeling of hollowness that encountering LLM writing brings. 9. Each new sentence in an LLM twin is more likely to introduce a new common noun ("displacement," "war," etc.). But it's less likely to introduce a new, specific, verifiable fact. A human would write: "Parents want to know if their children are alive and when they will come home. An inquiry has been launched by the Nigerian government..." An LLM would write: "For the parents, the question is simple. They want to know if their children are alive and when they are coming home." This is, of course, from studying 200 samples. Pangram has millions, and its neural networks, as unexplainable as this technology is, can probably be contextualised as checking tens of thousands of such "tics." Importantly, none of these is consequential on its own, but in LLM writing all these features tend to go together. That's why people who work a lot with LLMs can often (but not always) recognise their style.
12
26
4
341
17,172
Hayley in the Stack retweeted
I'm glad we're debating the proper uses of Pangram. Here are my views about it: 1. Awesome tool with a very low false positive rate. 2. Teachers should use it freely and so should journals. 3. It needs subtler categories in many cases, and more of a gradient between them. 4. We need a better public understanding of what a partial score means. 5. Some people use Pangram for apt social shaming, some use it for inapt social shaming, and we need ways to distinguish between its apt and inapt uses.
15
14
1
112
10,645
Hayley in the Stack retweeted
Unpopular opinion: In 5 years, "made with Al" will mean as little as "made with Photoshop."
87
100
17
1,613
24,769
Hayley in the Stack retweeted
I regret to inform you all that we have found our first long false positive from 2006 it's a poem where the same 6 words are repeated four thousand times
176
280
99
13,461
1,370,860
Hayley in the Stack retweeted
BREAKING: Microsoft says attempts to fix global outage not going "as expected," per BBC
546
1,473
347
19,749
1,278,956