Rendered at 14:09:48 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
killingtime74 1 days ago [-]
I did a task that cost about $1.5 on API. It was 4 million tokens. That will take about 2.9 years at this rate.
Estimating an electricity cost in the three digits
a012 1 days ago [-]
You almost got me, it’s 2.6 tokens/minute
361994752 1 days ago [-]
I fell into the trap (again)
spottedmarley 1 days ago [-]
Nice! Totally different subject but, have you tried Ling-mini on it? It's really good for how small it is and you can run it on damn near anything and be useably quick.
esperent 1 days ago [-]
That's 23 seconds for 1 token. Unusable, in other words. The title seems to be intentional written to obfuscate that.
Estimating an electricity cost in the three digits