Follow

Speeding up your calculations

Broadly, there are two ways to speed up your calculations with Domino.

  1. In your project's Settings, you can upgrade your hardware. Each run will use the hardware you specify, up to machines with 32 cores and 240GB of memory.

  2. You can start as many concurrent runs as you want, thereby "manually" parallelizing your work. Each run you start gets its own machine, so you can take advantage of dozens of machines at once.

Note: The more powerful the hardware, the more expensive your run becomes. Specifically, more powerful hardware costs more per minute. Be conscience of how long each run takes and how many concurrent runs you have going if budget is a consideration.  

By the way, if you need to work more interactively, you can spin up an IPython/Jupyter Notebook session, or an "R Notebook" session. They will use your current hardware tier, just like running a script would do.

Pro tip: many of our machine have multiple cores, and there are tons of great libraries in R and Python to take advantage of multiple cores for faster computation.

We wrote a blog post about parallelizing your code, and here are a few more specific resources:

Was this article helpful?
0 out of 0 found this helpful

Comments