Subsections


4.1 How to use interactive data analysis servers

Interactive data analysis servers consist of 20 middle-range interactive data analysis servers (kaim[01-20].ana.nao.ac.jp) and 12 high-end interactive data analysis servers (kaih[01-12].ana.nao.ac.jp). The purpose of these servers is to reduce and analyze astronomy data interactively. Users access a server from the personal computer, terminal workstations, or remote login terminal computers with SSH connection. If you would like to perform a non-interactive calculation which requires a lot of calculation resources, please use the batch processing data analysis servers introduced in Section 4.2.


4.1.1 System configuration

Interactive data analysis servers consist of 32 servers (FUJITSU Server PRIMERGY RX2530 M2). These servers are classified with middle-range interactive data analysis servers and high-end interactive data analysis servers from the difference in the performance of the Random Access Memory (RAM) and Hard Disk Drive. A middle-range interactive data analysis server has 192GB RAM and 12TB HDD, while a high-end interactive data analysis server has 256GB RAM and 51TB HDD. Each server is installed the Red Hat Enterprise Linux 7.
Table 4.1: Specification of the middle-range interactive data analysis server
Host name kaim[01-20].ana.nao.ac.jp
Machine FUJITSU Server PRIMERGY RX2530 M2
Quantity 20
OS Red Hat Enterprise Linux 7
CPU Intel Xeon E5 2667 V4 3.2 GHz 16 core
RAM DDR4 2400 RDIMM 192GB
HDD of the local disk region 1.8 TB 2.5 inch SAS 10000 rpm
Size of the local disk region 12.24 TB
Table 4.2: Specification of the high-end interactive data analysis server
Host name kaih[01-12].ana.nao.ac.jp
Machine FUJITSU Server PRIMERGY RX2530 M2
Quantity 12
OS Red Hat Enterprise Linux 7
CPU Intel Xeon E5 2667 V4 3.2 GHz 16 core
RAM DDR4 2400 RDIMM 256GB
HDD of the local disk region 10 TB 3.5 inch NLSAS 7200 rpm
Size of the local disk region 51 TB


4.1.2 How to login

The way to access the interactive data analysis servers differs from each other depending on whether the client terminal is on the NAOJ network (KTnet) or not because the machines of the MDAS is on the NAOJ network. If the client terminal is not on the NAOJ network, you must establish VPN connection before access the interactive data analysis servers. We introduce the ways to access the interactive data analysis servers in the situations where the client terminal is on the NAOJ network or not.

From the client terminal on the NAOJ network

We introduce how to access the interactive data analysis servers from the client terminal connecting to the NAOJ network. There are two possible ways to access the interactive data analysis servers. One is the way to access a load balanser, and the other is the way to access a server directly. We recommend to access a load balancer because you can login to a server having a low usage automatically by access the load balancer. However, you cannot choose a server when you access a load balancer, so if you use a local disk of each server, you have to access the server directory.

Table 4.3: Address of the interactive data analysis servers
Server Host name Load balancer (recommended to connect)
Middle-range servers kaim[01-20].ana.nao.ac.jp kaim.ana.nao.ac.jp
High-end servers kaih[1-12].ana.nao.ac.jp kaih.ana.nao.ac.jp

Login to the middle-range interactive data analysis servers

You should access the "kaim.ana.nao.ac.jp" which is the load balancer of the middle-range interactive data analysis servers. Please input commands to your terminal as follows. The "your_account" and "your_password" represent your account and password you got.
$ ssh [-X] your_account@kaim.ana.nao.ac.jp
your_account@kaim.ana.nao.ac.jp's password:your_password

If you use the "/wkm[01-20]" which are the local disk regions of the middle-range interactive data analysis servers, you should access each server directly.

$ ssh [-X] your_account@kaim[01-20].ana.nao.ac.jp
your_account@kaim[01-20].ana.nao.ac.jp's password:your_password

Login to the high-end interactive data analysis servers

You should access the "kaih.ana.nao.ac.jp" which is the load balancer of the high-end interactive data analysis servers. Please input commands to your terminal as follows. The "your_account" and "your_password" represent your account and password you got.
$ ssh [-X] your_account@kaih.ana.nao.ac.jp
your_account@kaih.ana.nao.ac.jp's password:your_password

If you use the "/wkh[01-12]" which are the local disk regions of the high-end interactive data analysis servers, you should access each server directory.

$ ssh [-X] your_account@kaih[01-12].ana.nao.ac.jp
your_account@kaim[01-12].ana.nao.ac.jp's password:your_password

From the client terminal not on the NAOJ network

If the client terminal is not on the NAOJ network, you must establish the VPN connection in order to connect to the NAOJ network. The ADC offers two VPN services (sea Section 3.2), which are the MDAS VPN service and the NAOJ VPN service. After you establish the VPN connection, you can access the interactive data analysis servers with SSH connection introduced in "From the client terminal on the NAOJ network".

How to use the MDAS VPN service

In order to establish the VPN connection of the MDAS VPN service, you have to use AnyConnect, which is a VPN client software. Please download and install the AnyConnect according to the procedure written in the E-main you got after you apply the MDAS VPN service. When you establish the VPN connection, you have to connect to the MDAS VPN servers, The "kaimvpn.ana.nao.ac.jp" or "kaihvpn.ana.nao.ac.jp" using AnyConnect. Please input your account and password into the window of the AnyConnect. Note that you can login to the middle-range or high-end interactive data analysis servers from both the "kaimvpn.ana.nao.ac.jp" and "kaihvpn.ana.nao.ac.jp".
Table 4.4: MDAS VPN server
Server Host name
VPN server m kaimvpn.ana.nao.ac.jp
VPN server h kaihvpn.ana.nao.ac.jp

How to use the NAOJ VPN service

Please refer to https://nethelp.mtk.nao.ac.jp/contents/en/node/4 for details of the NAOJ VPN service.


4.1.3 Disk spaces

The following disk spaces are available on the interactive data analysis servers.
Table 4.5: Disk spaces available in the interactive data analysis servers
Space Mount point Size per a mount point Soft/Hard limit Retention period
User home directory (NFS) /home[01-02] 55TB 140GB/150GB As long as your account in force
Large volume file system (NFS) /lfs[01-16] 102TB 30TB・32TB 12 months
Local disk space of the middle-range servers /wkm[01-20] 12TB None/None 12 months
Local disk space of the high-end servers /wkh[01-12] 51TB 14TB/16TB 12 months

Periodic data deletion

Periodic data deletion will be carried out in the scheduled maintenance. The policy of this deletion is as follows: If a disk space exceeds a utilization of 90% as of 2 weeks before the scheduled maintenance, then the disk space will be a target of the periodic data deletion. If a disk does not exceed a utilization of 90%, the disk space will not be a target. Files to be deleted are decided just before the scheduled maintenance.

Disk quotas

The MDAS implements disk quotas in order to set a limit on the disk usage of each user. The soft limit and hard limit of the quotas are different in each disk space. If an amount of your data amounts to the limit, then any software do not run normally, so you should copy or remove your data before an amount of your data amounts the limit.


4.1.4 Network access control

You cannot access (i.e. ssh, scp, or rsync) computers on the NAOJ network from the interactive data analysis servers for a security measure. If you would like to download data from the interactive data analysis servers, please execute commands such as "scp" and "rsync" on your computer.w
$ scp your_account@kai[mh][01-20].ana.nao.ac.jp ~/your/computer

ADC
2019-07-19