Project Spotlight

AI/GPU Roadmap Spotlight: Golem-Workers

Arek Cybulski

• 2 min read

What is Golem-Workers?

Golem-Workers is an API providing direct and high-level access to GPU and CPU resources on the Golem Network. Unlike services focused solely on specific tasks such as AI model deployment and inference, Golem-Workers offers greater flexibility, catering to a variety of computational needs. This API empowers developers and companies to leverage the decentralized power of the Golem Network for diverse applications, ranging from fine-tuning AI models to data processing tasks.

Why Are We Doing It?

This initiative comes as a response to the high demand for computing power in the AI/ML industry. It also supports our goal of driving demand for providers on the Golem Network and promoting its broader adoption within the AI and tech communities.

For Whom It Is?

This API is designed for AI application creators, including developers, startups, and companies that require GPU or CPU computing power.

Technical Implementation 

From a technical perspective, it consists of a Python web server with simple Web API endpoints. Web API calls can manage workers and their clusters. 

It allows to directly configure worker settings from the endpoint or utilize shared configuration references from the cluster. In the background, the complexity of the distributed market is seamlessly managed by an extensible library of ready-to-use actions.

Benefits for Users

  • High Flexibility: Implement calculations beyond just AI. Simply prepare an image and load it onto rented workers.
  • Competitive Pricing: Affordable rates for workers, especially GPU workers.
  • Support the Ecosystem: Contribute to the Golem Network ecosystem.

Synergy with Other AI/GPU Projects

The first version of the Golem-Workers PoC was developed and tested in Modelserve. Golem-Workers is part of a broader strategy to integrate with other projects within the Golem Network ecosystem. 

Milestones and Next Steps

Current Progress

  • We are currently at the Proof of Concept stage.
  • We are beginning to test the solution with our first partners.

Future Plans

  • Preparing the Minimum Viable Product (MVP) of Golem-Workers.
  • Conducting market validation with creators, developers, and partners.

How to Get Started with Golem-Workers

Start with simple examples illustrating basic use. Get familiar with a library of ready-to-use actions to compose a flow that suits your needs. Dive deeper and implement custom actions for advanced use cases. Keep the web server or even use Golem Worker's Python code directly.

Repository containing the code and usage examples will be available soon here.