• If you are not on campus, all connections to Comet must go via finan (unix.ncl.ac.uk), this includes data transfers.
  • Ensure you have done just-in-time authentication to allow your user to connect to unix.ncl.ac.uk using https://ama.ncl.ac.uk/Role/AccessRequest
  • rsync and scp both use ssh connections when transferring data between different hosts.
  • Don't use ProxyJump when ON campus - your data will travel via multiple hops over slow network connections.
  • Use rsync with the additonal ProxyJump argument for -e (use ssh) with the syntax -e “ssh -o ProxyJump=user@unix.ncl.ac.uk” 

user@laptop /home % rsync -avz -e "ssh -o ProxyJump=user@unix.ncl.ac.uk" --stats --progress ~/tempdir  user@comet.hpc.ncl.ac.uk:~/TestDir/ --dry-run
(user@comet.hpc.ncl.ac.uk) Password: 
sending incremental file list
tempdir/
tempdir/2ndfile
tempdir/afile
tempdir/testfile
tempdir/dir1/
tempdir/dir1/file1
tempdir/dir1/file2
tempdir/dir2/
tempdir/dir2/file3
tempdir/dir2/file4

Number of files: 10 (reg: 7, dir: 3)
Number of created files: 10 (reg: 7, dir: 3)
Number of deleted files: 0
Number of regular files transferred: 7
Total file size: 0 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 0
File list generation time: 0.006 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 307
Total bytes received: 49

sent 307 bytes  received 49 bytes  41.88 bytes/sec
total size is 0  speedup is 0.00 (DRY RUN)