da_cow (she/her)@feddit.org to 196@lemmy.blahaj.zoneEnglish · 2 months agolet me rule to you: Israel GPTfeddit.orgimagemessage-square97linkfedilinkarrow-up11.02Karrow-down121
arrow-up1995arrow-down1imagelet me rule to you: Israel GPTfeddit.orgda_cow (she/her)@feddit.org to 196@lemmy.blahaj.zoneEnglish · 2 months agomessage-square97linkfedilink
minus-squareboonhet@sopuli.xyzlinkfedilinkEnglisharrow-up5·2 months agoThey can be deterministic, but you can vary the temperature and also use seeds
minus-squarevoodooattack@lemmy.worldlinkfedilinkEnglisharrow-up1·2 months agoI didn’t say they normally aren’t. What I’m saying is that a shared KV-Cache removes that guarantee by introducing an external source of entropy.
They can be deterministic, but you can vary the temperature and also use seeds
I didn’t say they normally aren’t. What I’m saying is that a shared KV-Cache removes that guarantee by introducing an external source of entropy.