Versions Compared
Key
- This line was added.
- This line was removed.
- Formatting was changed.
1.0 Introduction
In short, the Jupyter Notebook is a server-client application for editing and running notebook documents through a web browser. JupiterHub is a multi-user server which spawns and manages multiple single user notebook instances.
In practice this means that JupyterHub acts as a portal for multiple concurrent users, providing access to the shared resources. For example GPU's of the HPC environment, allowing the user to use Jupyter Notebook through web browser.
2.0 Access
You can access JupyterHub through web interface at hub.cs.helsinki.fi, available from VDI machines. To use the resources through JupyterHub, you still need access to the cluster resources. Eg. need to either:
- be member of CS staff or
- have your (research or course) IDM group as member of grp-cs-ukko2 IDM group
You have to log into turso.cs.helsinki.fi at least once for the automation to create an environment and to establish your directories. After this, no further logins to turso are required if you only wish to use Hub.
Please note that it might take up to 2 hours after you have been added to either group before your home directory gets created. If you do not have access, but would like to have one, please request the manager/owner of your IDM group to send note to helpdesk(at)helsinki.fi, specifying which group needs to have access to the clusters. Please note that keeping the IDM groups up to date is the responsibility of the group owners.
https://hub.cs.helsinki.fi/
3.0 environments
You may have used Python virtual environments in the past on the interactive sessions, and same guidelines are followed here, with some minor tweaks.
3.2 Ready environments
Readily installed environments include for example Matlab and R.
3.2 SetUp your own Python virtual environment
You may of course use already created Python virtual environment, or create a new one from the scratch. First open Terminal session:
- Click File → New and choose Terminal from pull down menu
- Create a new virtual environment or use a existing one
- new virtual environment cheat sheet (TODO)
- Activate your environment (here we call it by name myenv)
source myenv/bin/activate
- With this environment activated, you can install any package you want using “pip install PACKAGENAME“, or if a particular version is needed “pip install PACKAGENAME=versionnumber”
3.3 Add your own environment to Jupyterhub
- To make your newly created, or old Python virtualenv appear in Jupyterhub, type in the terminal window the following command:
python -m ipykernel install -- user --name myenv --display-name “Python (myenv)”
- When start a Jupyter session next time, you can open the session in your new environment and use/install/remove/manage any package you want without extra privileges!
- You can find good resources online.
4.0 Resources
You can select different sessions from the JupyterHub startup screen, see an example below. This includes variations on the core counts, memory and length of the intended session. Users are able to choose both CPU and GPU resources.
4.1 Current session limits
Currently users are limited to interactive sessions with maximum of one day. Should you run longer jobs, we advice you to submit a batch job instead of running multi-day interactive sessions.
System | Time Limit | Memory | Cores |
---|---|---|---|
Vorna compute | 1 Day | 1.5GB | 1 |
Vorna compute | 1 Day | 6GB | 4 |
Vorna compute | 1 Day | 12GB | 8 |
P100 GPU | 4 Hours | 12GB | 4 |
P100 GPU | 1 Day | 12GB | 4 |
We do reserve right to make changes on the resource availability over time.
Table of Contents |
---|