Sure, thanks for your interest. It’s an incomplete picture, but we can think of LLMs as an abstraction of all the meaningful connections within a dataset to a higher dimensional space - one that can be explored. That alone is an insane accomplishment that is changing some of the pillars of data analysis and knowledge work. But that’s just the contribution of the “Attention is All You Need” paper. Many implementations of modern generative AI combine LLM inference in agentic networks, with GANs, and with rules-based processing. Extracting connections is just one part of one part of a modern AI implementation.
The emergent properties of GPT4 are enough to point toward this exponential curve continuing. Theory of mind (and therefore deception) as well as relational spatial awareness (usually illustrated with stacking problems) developed solely from increasing the parameter count describing the neural network. These were unexpected capabilities. As a result, there is an almost literal arms race on the hardware side to see what other emergent properties exist at higher model sizes. With some poetic license, we’re rending function from form so quickly and effectively that it’s seen by some as freeing and others as a sacrilege.
Some of the most interesting work on why these capabilities emerge and how we might gain some insight (and control) from exploring the mechanisms is being done by Anthropic and by users at Hugging Face. They discovered that when specific neurons in Claude’s net are stimulated, everything it responds with will in some way become about the Golden Gate Bridge, for instance. This sort of probing is perhaps a better route to progress than blindly chasing more size (despite its recent success). But only time will tell. Certainly, Google and MS have had a lot of unforced errors fumbling over themselves to stay in what they think is the race.
I’m happy to take the time to alter your perspective, if you are open to new information.
Did you watch Breaking Bad?
Rabbit season
Our Fall is quite autumnal.
If you’d like to try it for yourself, here’s the space on Hugging Face. It’s… not great.
Wrenched from the platonic forms through seething quantum foam as the Demiurge’s machinations reach fruition, our custom-made mounting clamps won’t fail you like your precious god.
I understand this perspective, because the text, image, audio, and video generators all default to the most generic solution. I challenge you to explore past the surface with the simple goal of examining something you enjoy from new angles. All of the interesting work in generative AI is being done at the edges of the models’ semantic spaces. Avoid getting stuck in workflows. Try new ones regularly and compare their efficacies. I’m constantly finding use cases that I end up putting to practical use - sometimes immediately, sometimes six months later when the need arises.
Part of my job is to write that kind of copy. If you take it seriously, you’ll drive yourself nuts.
Very interesting! I’ll check it out. Thanks for the recommendation.
I just meant I work for a corporation. I produce videos for marketing, been doing it for 25 years.
What tasks are you thinking about?
It saves me 10-20 hours of work every week as a corpo video producer, and I use that time to experiment with AI - which has allowed our small team to produce work that would be completely outside our resources otherwise. Without a single additional breakthrough, we’d be finding novel ways to be productive with the current form of generative AI for decades. I understand the desire to temper expectations, and I agree that companies and providers are not handling this well at all. But the tech is already solid. It’s just being misused more often than it’s being wielded well.
Don’t blame CEO tomfoolery on generative AI. Generative AI is amazing.
I am super impressed by Blender, but there’s not really a substitute for After Effects yet, open source or otherwise.
For a second, I thought he was an elf or a Vulcan.
Maybe, or a bigger ISP wants to get in on that rural turf. But I was wondering what else the malware may have done before physically destroying those routers. I also kinda wonder if this might be a test run for a larger attack. And now I’m imagining what it might be like if everyone’s routers bricked in a 72 hour period. I think I’ll pick up some extra TP tomorrow.
That’s concerning for… a lot of reasons.
This is another good use case for gAI. Copy/paste the comment into a GPT and tell it to re-write the content at the desired reading or technical level. Then it’s available for follow-up clarification questions.