• 0 Posts
  • 3 Comments
Joined 1 year ago
cake
Cake day: July 1st, 2023

help-circle
  • Kevin@programming.devto196@lemmy.blahaj.zoneThe Rule
    link
    fedilink
    arrow-up
    7
    ·
    edit-2
    2 months ago

    They stand for Floating Point 16-bit, 8-bit and 4 bit respectively. Normal floating point numbers are generally 32 or 64 bits in size, so if you’re willing to sacrifice some range, you can save a lot of space used by the model. Oh, and it’s about the model rather than the GPU