Show more

LLMs don’t actually know English grammar, they just abstract patterns from many examples of utterances in English. You and I, of course, humans, with a conscious mind that we can see and understand via the simple expedient of naïve empiricism, we simply read that book that fully enumerates the rules of English grammar (you remember? the book?) when we were infants. QED.

Show thread

There are a lot of people who think they are making really impressive critiques of LLMs when they are doing the equivalent of saying “Dogs can’t eat chocolate because truly experiencing chocolate requires a spark of the divine, and as as we all know, dogs do not have souls. So don’t feed dogs chocolate.”

You have arrived at the correct conclusion that maximalist claims about LLMs are very wrong. But you did it with reasoning worse than the LLMs can do.

If I were a journalist covering the balloons, I would be talking to Ben. He seems to be finding them in open data, which provides some actual facts in a story that’s very short on them. mastodon.social/@benelsen/1098

The kids on TikTok are obsessed with this new trend called the Don’t Uncritically Platform Dangerous Transphobia in a Paper of Record and Deflect Valid Criticism Like a Coward challenge and you’ll never believe the dance that goes with it!

Alright, I think this is an actual image of The Balloon on Feb 1 via Sentinel 2B.
The tile is T12TWS @ 2023-02-01 18:15z (I used the L1C product)
Coordinates are -110.473 46.429.
In image 3 the probable balloon is the pink dot, the green is my best fit trajectory from Billings to the shoot down. The orange lines are equal time lines for varying starting altitudes in Billings.
I checked against fr24 and adsbexchange and nothing really close on there.

Show thread

GNSS stuff 

Last I played with consumer GNSS hardware much, the SiRFstarIII was considered very cool.

I just ran a new NEO-N9M overnight under a residential roof (no survey mode or anything) and got this wonderfully clean pattern.

All units are meters. I don’t know what pAcc actually is and neither does the official documentation.

This is like $50 for a USB-capable board with shipping and tax from a reputable seller. I’m delighted.

There’s what I would describe, in technical terms, as a “lazy fantasy map” vibe to the distribution of NGS survey markers.

@ingrid Tom Hardy giving the newbie an up-and-down look and saying “If you’re looking for a place to start, try ‘Ground Truth: The Social Implications of Geographic Information Systems’. Edited by John Pickles. ’94 or ’95.”

@paulmison Anyway, for the word count and the presumed audience, I think this is a spectacularly good piece and will be recommending it.

@paulmison Specifically, I think it’s super relevant to point out that lossy compression is often used as a backbone for lossless compression (predictor + residual models). That tells us something about all these issues. But I also see why that would be one of the first paragraphs you’d cut for space and focus.

@paulmison I think focusing on compression is very good (it’s how I tend to think about this stuff) but the exact phrasing of why people don’t use LLMs on the Hutter Prize is basically wrong as stated. Probably down to editorial brevity decisions, not misunderstanding, though.

@paulmison For example, I think the no-output-as-input argument is correct but not as airtight as it might seem to a lay reader – one could argue that it’s more just a redundancy thing.

I have quibbles with this but they’re “why didn’t you mention this important detail” kinds of things. I think it’s admirably clear and fundamentally right-headed. newyorker.com/tech/annals-of-t

smarmy, painfully literal posters who seem to be typing out unconsidered impressions of the world ← [the infinitesimally small but infinitely correct space that I occupy] → internet-poisoned edgelords nine layers of irony away from their own feelings

@kissane Whereas I’m kind of embarrassed by how much fun the image generators are for me.

Also, as a third category, doing little projects in domains that interest me on my home workstation has been one of my most fulfilling pandemic hobbies. It’s given me a bunch of new metaphors and produced nothing Useful, so, huge success.

Show more
Horsin' Around

This is a hometown instance run by Sam and Ingrid, for some friends.