• wndy@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      1 day ago

      Not people who can’t afford 100k to spin up their own servers. It’s going to be a game changer for AI startups and such though who won’t have to spend as much as previously thought.

      edit: Basically, numbers out of my ass, but it’s like they reduced the amount you have to spend to get chatgpt-level output from $500k to $100k. Amazing and all, definitely newsworthy, but uh… not directly relevant for us little folk, more about the ripple effects

    • Architeuthis@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 days ago

      The 671B model although ‘open sourced’ is a 400+GB download and is definitely not runnable on household hardware.