• Not_mikey@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    3
    ·
    16 days ago

    Can you reasonably train a local model? Inference is one thing and can be run on a decent gaming graphics card but training requires a lot more compute.

    • Dran@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      16 days ago

      You can absolutely train a nontrivial task model on a gaming gpu (image classifier, sound classifier, text model with a very structured input and output, etc). You can also post-train addon layers on top of existing open-weight models (LORA).

      • utopiah@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        15 days ago

        Can you train it better than anything already available on model zoos for free though? If not then beside learning I dont see the point.

    • frongt@lemmy.zip
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      16 days ago

      Depends on the size of the training data, how big the resulting model is, and how fast you want it to finish.