• WalnutLum@lemmy.ml
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    I’ve seen this said multiple times, but I’m not sure where the idea that model training is inherently non-deterministic is coming from. I’ve trained a few very tiny models deterministically before…

    • umami_wasabi@lemmy.ml
      link
      fedilink
      arrow-up
      0
      ·
      2 months ago

      You sure you can train a model deterministically down to each bits? Like feeding them into sha256sum will yield the same hash?