They stand for Floating Point 16-bit, 8-bit and 4 bit respectively. Normal floating point numbers are generally 32 or 64 bits in size, so if you’re willing to sacrifice some range, you can save a lot of space used by the model. Oh, and it’s about the model rather than the GPU
- 0 Posts
- 4 Comments
Joined 1 year ago
Cake day: July 1st, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
It’s odd that I can narrow this picture to Bangalore
That list doesn’t sound half bad tbh
I hate that I recognise that video playing on the TV, damn you Gianni