Skip to main content

Container metaframe: remote mode

The container metaframe allows metapage workflows in the browser to run any kind of code or process via docker containers: python, R, C++. Your computer or cluster can then run any workflows without any manual installation or configuration.

Run the worker agent

Each worker agent connects to a job queue, take jobs from the queue, process the job, and return the results back to the queue, where the job state is stored.

To run a worker you need:

Create a queue key

Workers and clients connect to the same queue to exchange work. The URL of the queue is a secret known only to the worker and the browser client, you should not reveal your queue key.

Command

Then run this terminal command to start the metaframe container worker agent in remote mode, listening for jobs on <queue> (replace with your own queue)

docker run --rm -v /var/run/docker.sock:/var/run/docker.sock \
-v /tmp:/tmp metapage/metaframe-docker-worker:0.54.2 \
run --data-directory /tmp/worker-metapage-io-remote \
--cpus=2 <queue>

The container metaframes in a workflow send jobs to a remote queue via the api. Workers connected to that same queue then pick up and run the jobs.

Related topics