You’re right, I looked up the highest Intel GPU count but forgot that they released desktop cards. Intel iGPUs “only” have 768 cores, it’s the Ampere cards that have thousands of cores.
JSON is UTF-8 so it can be up to three bytes per token theoretically. Depends on the language you’re processing, I guess.
deleted by creator
yea we need multithreaded json parsers
CUDA accelerated JSON parser is sorely needed
Doesn’t a 3070 have less than 7k cores? A UHD 750 (relatively recent iGPU) only has 256.
And I don’t know the structure of JSON that well, but can’t tokens be made of multiple chars?
You’re right, I looked up the highest Intel GPU count but forgot that they released desktop cards. Intel iGPUs “only” have 768 cores, it’s the Ampere cards that have thousands of cores.
JSON is UTF-8 so it can be up to three bytes per token theoretically. Depends on the language you’re processing, I guess.