DeepSeek's R1-0528 model is the most powerful open-source reasoning model that rivals GPT 4.5 and o3. Learn to run the model with Unsloth 1.78-bit Dynamic quants.
Generally speaking would people want to run it on their own personal hardware? Or are there VPS-like services which allow people to run their own models?
For sure there are VPS services available for this. However, it’s sad how much we need a powerful rig with 32GB RAM just to do regular development or test new FOSS stuff these days (for the sake of being melodramatic).
Generally speaking would people want to run it on their own personal hardware? Or are there VPS-like services which allow people to run their own models?
For sure there are VPS services available for this. However, it’s sad how much we need a powerful rig with 32GB RAM just to do regular development or test new FOSS stuff these days (for the sake of being melodramatic).