We want to build a new server to expand CrofAI. You can
help out (and get unlimited usage) by buying lifetime
unlimited usage for $100. This offer is available to the
first 20 people.
(Due to the small quantity and significantly different system,
accounts are being updated manually to ensure that things go as planned.
If your account is slow to update, please reach out. Price is 105 to account for additional fees).
Hi there! I started CrofAI roughly a year ago and the project has changed substantially since then. Despite this, there’s always been two things I’ve really wanted to do. The first, is to save people as much money as I (reasonably) can on scalable LLM inference. The second is to build custom infrastructure to run inference (which would contribute to the first goal).
If we could have just 1 or even 2 servers powerful enough to run some AI models, we could reduce the amount of load we put on the cloud servers (or even run it all on our infra when the usage reaches significant lows). Having cheaper, dedicated infrastructure could also allow me to build something I’ve wanted to for a really long time. Affordable hosting for custom models (or really just any models that we don’t already host).
Currently, we have a plan to build and run (at least) 1 server that would allow us to deploy a feature allowing you to run any gguf file on huggingface (with file size limitation. But we would slowly increase the max size overtime). However, the issue is the cost. The build we have in mind would cost around $1,000 if we wanted to leave room for experimentation and new parts if something went wrong. That’s what we’re looking to raise, and our solution is to sell unlimited usage at $100 per account. This would allow us to reach our goal if just 10 users bought this. We are limiting it at 20 users to potentially build a second and even more powerful server.
I’ve always liked the idea of doing things my way. Not that I’ll necessarily do it right or anyone else would do it wrong, but if I make a mistake I can own up to it and apologize for the mistake and I don’t risk someone trying to make us do things in ways that we don’t want to, or might hurt the community. This way, you can get something useful out of it (no waits or delays), the community gets new features, and we don’t lose our control over the project.
If we can build an affordable inference server for under $1,000 that runs modern LLMs, we could sell our hardware and users could even buy their own boxes for running AI that are more affordable than traditional AI machines.
No matter what happens, you purchased unlimited usage. Even if you're the only one to buy it, your purchase is appreciated and your account will be updated accordingly. If you buy unlimited usage then you will get unlimited usage.