swiftywizard@discuss.tchncs.de to Programmer Humor@programming.dev · 27 days agoLavalamp too hotdiscuss.tchncs.deimagemessage-square76linkfedilinkarrow-up1496arrow-down113
arrow-up1483arrow-down1imageLavalamp too hotdiscuss.tchncs.deswiftywizard@discuss.tchncs.de to Programmer Humor@programming.dev · 27 days agomessage-square76linkfedilink
minus-squarebunchberry@lemmy.worldlinkfedilinkarrow-up1·25 days agoAt least llama.cpp doesn’t seem to do that by default. If it overruns the context window it just blorps.
minus-squareFishFace@piefed.sociallinkfedilinkEnglisharrow-up1·24 days agoI think there are parameters for that, from googling.
At least llama.cpp doesn’t seem to do that by default. If it overruns the context window it just blorps.
I think there are parameters for that, from googling.