Would it be possible on cards like 3060 with 12gb of ram? What is limited factor... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

hsuduebc2 on Feb 21, 2023 | parent | context | favorite | on: Running large language models like ChatGPT on a si...

Would it be possible on cards like 3060 with 12gb of ram? What is limited factor here? Memory or computational power?

Good job!

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact