anywhere shit gets cliquey it gets toxic real fast - and that goes for ANY and ALL organisations.

safe-space concepts often inherently deals with an “us/them” dichotomy, which is unfortunately fertile ground for things getting cliquey.

it’s not that one must lead to the other, its just that the foundation is there so the risk is higher if it’s not managed properly.

this is why safe-spaces need to be protected from within and without. regardless of whether you’re in the clique or out of it, it hurts everyone in the end.

who?

where/how/what are you eating copper which permits you to taste it?

is the machine the problem? that seems more like a philosophical or semantic debate.

the machine is not fit for the advertised purpose.

to some people that means the machine has a fault.

to others that means the human salesperson is irresponsibly talking bs about their unfinished product

imo an earnest reading of the logs has to acknowledge at least potential evidence of openai’s monetisation loop at play in a very murky situation.

no, they steal everything.

why do we keep letting them steal

‘free speech’ has always been about the freedom of the oppressed to fight upwards against their oppressor with language - but now they stole it & trying to make it mean their freedom to oppress minorities.

same for ‘woke’ - it used to mean basic human decency, once again they stole it & warped it’s meaning by pretending they’re the victims and it’s preventing their freedom (ie. their freedom to be a bigot).

same for ‘political correctness’, which was originally a criticism of using fake concern over moral issues for political agenda (sounds familiar), now warped beyond use.

swastika - used for THOUSANDS of years before the fucking nazis came along & stole it. now the cultures it actually belongs to get hate for practicing their ancient beliefs.

pepe and many others are a long list of things they steal and ruin.

why do we keep letting them steal?

i’m a piece of shit

and obviously lying about how well it worked out for me, or i wouldn’t be here forcing a smile for the camera and spruiking my latest bs

the crashes are a feature, not a bug

accept that this is the part of the animal kingdom you’ve been born into. we ALL have these types of interactions so noone can really judge anyone for it.

therefore just chuckle about it, and shrug it off.

Exactly!

Thanks for reading :) Realised i was going on a bit of a rant, but thought why not keep going lol

good points on the training order!

i was mostly thinking of intentionally introduced stochastic processes during training, eg. quantisation noise which is pretty broadband when uncorrelated, and even correlated from real-world datasets will inevitably contain non-determinism, though some contraints re. language “rules” could possibly shape that in interesting ways for LLMs.

and especially the use of stochastic functions for convergence & stochastic rounding in quantisation etc. not to mention intentionally introduced randomisation in training set augmentation. so i think for most purposes, and with few exceptions they are mathematically definable as stochastic processes.

where that overlaps with true theoretical determinism certainly becomes fuzzy without an exact context. afaict most kernel backed random seeds on x86 since 2015 with the RDSEED instruction, will have an asynchronous thermal noise based NIST 800-90B approved entropy source within the silicon and a NIST 800-90C Non-deterministic Random Bit Generator (NRBG).

on other more probable architectures (GPU/TPU) I think that is going to be alot rarer and from a cryptographic perspective hardware implementations of even stochastic rounding are going to be a deterministic circuit under the hood for a while yet.

but given the combination of overwhelming complexity, trade secrets and classical high entropy sources, I think most serious attempts at formal proofs would have to resign to stochastic terms in their formulation for some time yet.

there may be some very specific and non-general exceptions, and i do believe this is going to change in the future as both extremes (highly formal AI models, and non-deterministic hardware backed instructions) are further developed. and ofc overcoming the computational resource hurdles for training could lead to relaxing some of the current practical requirements for stochastic processes during training.

this is ofc only afaict, i don’t work in LLM field.

some people label themselves christian and feel that label is a free pass for venomous bigotry. my feeling is that’s perhaps a bit un-christ-like, actually.

ignoring the hate-brigade, lemmy users are probably a bit more tech savvy on average.

and i think many people who know how “AI” works under the hood are frustrated because, unlike most of it’s loud proponents, they have real-world understanding what it actually is.

and they’re tired of being told they “don’t get it”, by people who actually don’t get it. but instead they’re the ones being drowned out by the hype train.

and the thing fueling the hype train are dishonest greedy people, eager to over-extend the grift at the expense of responsible and well engineered “AI”.

but, and this is the real crux of it, keeping the amazing true potential of “AI” technology in the hands of the rich & powerful. rather than using it to liberate society.

LLMs could be made deterministic

Good reminder that LLM output could be made deterministic!

Though correct me if I’m wrong, their training is, with few exceptions, very much going to be stochastic? Ofc it’s not an actual requirement, but under real world efficiency & resource constraints, it’s very very often going to be stochastic?

Personally, I’m not sure I’d argue automation can’t be stochastic. But either way, OP asks a good question for us to ponder! The short answer imo: it depends what you mean by “automation” :)

If I identify as a vegan but I like to eat meat with every meal, am I really a vegan?

/thread

yep, there’s this weird trend to demonise cute animals.

you can’t even fucking mention koalas on reddit without some arsehole telling us they all have chlamydia every 53 seconds.

according to them, all dolphins suck, all ducks are shit, and all cute little marsupials who never harmed a fly are secretly evil incarnate.

what if all humans were judged by the actions of some humans? that’s a frying pan i’d rather not be in…

“Meet me in the middle, says the unjust man.

You take a step towards him, he takes a step back.

Meet me in the middle, says the unjust man.”

Thanks for the reference, from there I found the very impressive original Nature paper “A RISC-V 32-bit microprocessor based on two-dimensional semiconductors” fantastic stuff!!

From the paper, that’s almost a 40x improvement on comparable logic integration!

Some notes from the paper:

• Transistor channel length is 3 um
• Clock speed is 1 kHz

Typically this is where people like to shit on the design “cos muh GHz” etc, but tbf not only will people doubtless work on improving the clock speeds etc, but there’s plenty of applications where computation time or complexity isn’t so demanding, so i’m just excited by any breakthrough in these areas.

if this is a full RISCV implementation in 2D materials this is a genuinely impressive breakthrough!!

just want to add, it’s not the zoomer’s fault. they were intentionally raised in ignorance because its apparently profitable

fuck the corporations who’ve deliberately turned our living computers into soulless commercial brainwashing surveillance machines