NYU-Greene-HPC-Cheatsheet

Written by Yuanhe Guo (yg2709@nyu.edu)

A beginner guide for getting started with running python on nyu greene hpc.

Each time I want to setup a new environment on NYU Greene HPC, I have to go through the official documentation and search for the commands I need. Meanwhile, there exist quite a few common issues whose solutions are not covered by the offical documentation. So I decided to write a cheatsheet for myself and others who may need it.

I wrote some complex commands into bash scripts, so that getting python run flawlessly on NYU Greene HPC is as simple as ordering a burger in a fast food restaurant.

Check the wiki page to get started.

Acknowledgement

• The official documentation: HPC Home
• I started my journey with HPC by following HPC Notes by Hammond Liu

Topics covered in this cheatsheet

Please feel free to open an issue if you have any questions or suggestions.

• Prereq
  • Apply for NYU Greene HPC access
  • Basic Linux commands
  • Vim
  • Vscode
• Quick Starting Pack
  • Connect to HPC
  • Request CPU/GPU Sessions
  • Interactive sessions for conda
  • Jupyter Notebook
  • Batch jobs
• Manual Setup
  • Offical guide Index
• Trouble Shooting
  • How can I quit python/singualrity/runtime?
  • How can I jump back when kicked off by accident?
  • Disk quota exceeded
  • Could not login server through vscode
  • Out of Memory Error
  • Could not open singularity environment
  • Some linux commands could not be executed
• Advanced Topics (Useful Tricks)
  • Setup bashrc
  • Setup ssh key pairs
  • Collection of useful linux commands
  • Sharing files with Other HPC Users
  • Sending files to/from HPC
  • SSH Tunneling on GPU Nodes
  • AWS S3 Connection
  • Access through iPad