Rob Miles has a Youtuber-style animation channel with a new video to communicate the importance of AI safety, and the execution is absolutely top notch.

  • SSUPII@sopuli.xyz
    link
    fedilink
    arrow-up
    7
    ·
    10 months ago

    KoboldCPP now pretty much can run everywhere, even without a GPU. CPU only without Cuda on a 9th Gen i7 takes around 60 seconds to create a response, depending on complexity. That is actually an alright time for not hardware accellerated usage.

    Run whatever model you wanna run, I won’t judge. A lot of people use the software for mostly porn anyway alright.