People are buying v100s on ebay to run LLMs and Chinese manufacturers make custom PCIE boards for them. Older cards might not be useful for training but they're perfectly capable of doing inference work.