This page contains frequently asked questions about the Quest high performance computing cluster at Northwestern.
Allocations And Accounts
How do I get an account on Quest?
To join quest you will need to submit an allocation request form for either a Research I or Research II allocation. These forms can be found below.
Request Research Allocation Forms
A Research I allocation will provide you with 35,000 computational hours and 500 GB of storage. This allocation will fit the needs of the majority of our users. A Research II allocation will provide you with 500,000 computational hours and 2 TB of storage. Research II allocations are for projects with a very large computational need, however you will need to submit a lengthier allocation. Both allocation types are available free of charge, but we do request that a chartstring is provided for your research if possible. This chartstring would be used for internal tracking purposes so that we can see the impact Quest is having on research done on campus. Alternatively, you can opt to join an existing allocation. Please fill out the Join Existing Quest Allocation form.
How do I use GPUs on Quest?
There are four Quest5 nodes each equipped with two Nvidia K40 cards for general
access use. To access the general access GPU nodes, you will need to apply to
join the allocation "gengpu" via the form linked below.
Join GPU Allocation Form
Once you have submitted the form and have been approved, you can specify gengpu as the allocation ID and buyin for the queue type in your submission script to run jobs on the GPU nodes. When defining computing resources needed, you will need to also add gpus flags as in nodes=1:ppn=1:gpus=1
How do I join an existing allocation on Quest?
In order to get an account on quest, you must first fill out an application
form. After this application form is filled out, we will contact the CI of
that allocation, and they will either approve or deny your membership in
that allocation. If you would like to join multiple allocations, you will
need to submit separate applications for each allocation.
The link to join an existing allocation can be found here: Join Existing Allocation Form
After you have filled out this application, we will contact the CI for this allocation, generally within one business day after the receipt of the form.
How do I transfer files to and from Box on Quest?
The best way to transfer data between Quest storage and Box would be to connect to Quest with the FastX client and start a Gnome desktop session or a Gnome terminal session. Then launch a terminal (or in the terminal that is already launched, if you pick a Gnome terminal session) and type
module load firefox firefoxto launch the firefox browser. In that browser you can log into Box and transfer files.
Documentation on how to use FastX to connect to Quest is available here: Connecting to Quest with FastX.
How do I use Amazon AWS on Quest?
The Amazon CLI is a python package install and is simple to install on Quest. To install this package, type the following commands:
export PATH=$HOME/.local/bin:$PATH module load python/anaconda3.6 pip install awscli --upgrade --user
How do I use the Google Cloud SDK on Quest?
The Google Cloud SDK is not installed system-wide on Quest, but it is
possible for you to install it into your own home directory. You will need
to follow the instructions on this page: Google Cloud SDK Quickstart Linux.
Namely, use the following command to download the SDK inside your home directory:
curl -O https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-241.0.0-linux-x86_64.tar.gzThen unpack the archive:
tar xvfz google-cloud-sdk-241.0.0-linux-x86_64.tar.gzAnd then run the install script, which will update your $PATH variable to include the new directory you have just unpacked:
./google-cloud-sdk/install.shFrom there you can configure the Google Cloud SDK with your credentials, etc.
How do I transfer files to and from RDSS/Resfiles/FSMResfiles via Globus on Quest?
If you lose the ability to connect to a previously mounted fsmresfiles shares via globus, you can take the following steps to re-establish a connection:
- SSH to qglobus02.it.northwester.edu or qglobus02 from quest nodes with your NetID. This operation will automatically mount your FSMRESFILES share. There is no need to keep the ssh connection open, so you may exit at any time.
- Open http://www.globus.org in the browser, log in as a Northwestern user and go to the transfer files tab.
- The Quest endpoint name is "Northwester Quest" or "northwestern#quest". the RDSS endpoint is "Northwestern Quest RDSS" or "northwestern#rdss"
Scheduler and Job Submissions
I get the error "walltime too high for selected queue" when trying to submit a job.
This error indicates that you have specified your job to run for longer
than a given queue will allow. To allow this job to run, you will need to
either reduce the amount of walltime for the job to be within the selected
queue's limits, or define a larger queue with a higher walltime.
You can find a list of all queues and their walltime limits at https://kb.northwestern.edu/70717.
My job was killed on a login node.
From time to time, we encounter errors on the login nodes that require
killing all running jobs on that node to prevent it from crashing.
Unfortunately, your job may have been one of those that were
It is recommended that users submit interactive or batch jobs to the compute nodes to avoid such job cancellations. Login nodes are shared resources are intended as entry points to Quest for all users. Submitting CPU or memory heavy jobs will affect everyone trying to access Quest.
My jobs are being placed on systemhold.
Quest has a safety feature built in that will not allow jobs to run when an
allocation gets below a certain amount of hours. This prevents accounts from
running out of hours and jobs being terminated in the middle of a job and is
one of the most common reasons for jobs being placed on Systemhold.
You can run the command checkproject <allocation ID> to see
how many hours you have remaining in your location. You may request
additional computational hours by following the link below.
Extend Allocation Request Form
Once we receive the request, you can expect to receive the additional hours within one business day. You can then continue with your job submission.
The software I want to use is not available on Quest.
If the software you require for your research is not available on Quest,
there are a few options you can try. The first is to perform a local
software installation to your home directory or project directory following
instructions specific to the software you are trying to install.
If a local install does not work, you can fill out the Software Installation Request Form. We will then assist you with the software installation.