Skip to content

Task creation fails with coordinator on VPS, worker local, and RabbitMQ on separate server #579

Description

@shitaanshus27

When running tork.run in a distributed setup with multiple components across different servers, task creation fails.

Setup:
Coordinator is deployed on a VPS cloud instance.
Worker is running on a local machine.
RabbitMQ is hosted on a separate server.
The coordinator is exposed via an endpoint, and tasks are triggered through a backend service.

Steps to reproduce:
Start RabbitMQ on a remote server.
Deploy the coordinator on a VPS cloud instance.
Run a worker on a local machine.
From the backend, push a job/task to the coordinator endpoint.
Observe that task creation fails.

Expected behavior:
The coordinator should accept the job, use RabbitMQ for message passing, and assign it to the available worker.

Actual behavior:
Task creation fails, and the worker does not receive the job.

Environment details:
tork.run version: 0.1.136 on coordinator and on worker 0.1.122
Coordinator environment: VPS (cloud)
Worker environment: Local machine
Message broker: RabbitMQ on a separate server
Communication: Backend service → exposed coordinator endpoint
Logs/Error messages:

2025-09-30 03:56:53 INF starting Coordinator
2025-09-30 03:56:54 INF Coordinator listening on http://localhost:8000
2025-09-30 03:56:54 ERR failed to deserialize message error="unknown message type: " body="Hi\r\n" queue=logs type=
2025-09-30 03:56:54 INF received first heartbeat hostname=srv1034414 node-id=34YWFcojL9pQHHeXum4UJw
2025-09-30 03:57:50 ERR Request error="code=404, message=Not Found" URI=/ method=GET remote-ip=180.151.90.24 status=404
2025-09-30 03:57:50 ERR Request error="code=404, message=Not Found" URI=/favicon.ico method=GET remote-ip=180.151.90.24 status=404
2025-09-30 04:01:28 ERR Request error="code=404, message=Not Found" URI=/robots.txt method=GET remote-ip=171.244.43.14 status=404
2025-09-30 04:01:28 ERR Request error="code=404, message=Not Found" URI=/ method=GET remote-ip=171.244.43.14 status=404
2025-09-30 04:16:39 ERR Request error="code=404, message=Not Found" URI=/ method=GET remote-ip=178.33.107.250 status=404
2025-09-30 04:21:11 INF received first heartbeat hostname=Sellcos-MacBook-Air.local node-id=KHKv9cvHiDk4o6Ht4z2vVp
2025-09-30 04:26:54 INF logs channel closed. reconnecting
2025-09-30 04:26:54 ERR failed to deserialize message error="unknown message type: " body="Hi\r\n" queue=logs type=
2025-09-30 04:29:26 ERR job b7a0eccbfde44adeba8d48391841e8f6 failed:
2025-09-30 04:29:26 ERR job 8f1b920c2bef44beaf45377adb56ba3f failed:
2025-09-30 04:29:26 ERR job 681f02c00d6d498487b56f4d3080dda7 failed:
2025-09-30 04:29:26 ERR job 76d95549eeba4bf6a76f46029174bafd failed:
2025-09-30 04:29:26 ERR job 28754da384a5418296737df160a2e7a4 failed:

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions