Upgrading the Tango virtual machine

# 8 years ago
Andy	Hi Philippe, I just downloaded the VM from home and it took < 1 hour. Average speed was 1.7 MB/s and I am not on RENATER. I think that either you were unlucky and the network was overloaded or there is a problem with bandwidth between your machine and the ESRF. Good to hear that you got it and have the list of packages now. Any feedback on what is missing or needs updating? Your feedback will be appreciated. I plan to make improvements to the current release candidate in the next weeks. Andy

# 8 years ago

Hi Philippe,

I just downloaded the VM from home and it took < 1 hour. Average speed was 1.7 MB/s and I am not on RENATER. I think that either you were unlucky and the network was overloaded or there is a problem with bandwidth between your machine and the ESRF.

Good to hear that you got it and have the list of packages now. Any feedback on what is missing or needs updating? Your feedback will be appreciated. I plan to make improvements to the current release candidate in the next weeks.

Andy

# 8 years ago
Philippe	Andy I just downloaded the VM from home and it took < 1 hour. Average speed was 1.7 MB/s and I am not on RENATER. I think that either you were unlucky and the network was overloaded or there is a problem with bandwidth between your machine and the ESRF. The FTP seems to be hosted in ESRF local network, so you probably downloaded it from the same local network. Could you confirm you got this bandwidth from the same local network? If so, perhaps someone could check the speed from outside? Andy Good to hear that you got it and have the list of packages now. Any feedback on what is missing or needs updating? Your feedback will be appreciated. I plan to make improvements to the current release candidate in the next weeks. Actually, I am doing a virtual machine on openstack, based on a debian. It seems we have all necessary soft, but I will netoify you if we miss anything for sure. - Philippe

# 8 years ago

Philippe

Andy
I just downloaded the VM from home and it took < 1 hour. Average speed was 1.7 MB/s and I am not on RENATER. I think that either you were unlucky and the network was overloaded or there is a problem with bandwidth between your machine and the ESRF.

The FTP seems to be hosted in ESRF local network, so you probably downloaded it from the same local network.
Could you confirm you got this bandwidth from the same local network?

If so, perhaps someone could check the speed from outside?

Andy
Good to hear that you got it and have the list of packages now. Any feedback on what is missing or needs updating? Your feedback will be appreciated. I plan to make improvements to the current release candidate in the next weeks.

Actually, I am doing a virtual machine on openstack, based on a debian.
It seems we have all necessary soft, but I will netoify you if we miss anything for sure.

- Philippe

# 8 years ago
Andy	Philippe, I got the download speed I mentioned above from outside the ESRF using ADSL from a private home. I am interested in your experience with OpenStack. How are you deploying the Tango VM? As it is or do you have to modify it? Andy

# 8 years ago
Philippe	Andy I got the download speed I mentioned above from outside the ESRF using ADSL from a private home. So I suppose it depends on the moment of the day. Andy I am interested in your experience with OpenStack. How are you deploying the Tango VM? As it is or do you have to modify it? My goal is to create a virtual server to host developping tools. OpenStack is a cloud solution hosted in our labs which allow to host and run VM into a more resilient way (and to add CPU or memory iof needed). I create a VM based on a debian image, preexisting on our openstack network, and I log in this VM to install TANGO. For this step, I used a script we create to configure our servers, dependending on the tools we need. Then, I have to install the packages I need. This is why I needed the list of packages installed into the tangobox. By the way, do you know if there is any special configuration for these packages (apart TANGO basic configuration with TANGOHOST) ? There is another way to create an openstack image, which consists into converting an existing VM to an openstack image, but I need access to OpenStack host network to use it. I wait for this access to try this way. - Philippe Edited 8 years ago

# 8 years ago

Philippe

Andy
I got the download speed I mentioned above from outside the ESRF using ADSL from a private home.

So I suppose it depends on the moment of the day.

Andy
I am interested in your experience with OpenStack. How are you deploying the Tango VM? As it is or do you have to modify it?

My goal is to create a virtual server to host developping tools. OpenStack is a cloud solution hosted in our labs which allow to host and run VM into a more resilient way (and to add CPU or memory iof needed).

I create a VM based on a debian image, preexisting on our openstack network, and I log in this VM to install TANGO.
For this step, I used a script we create to configure our servers, dependending on the tools we need.
Then, I have to install the packages I need. This is why I needed the list of packages installed into the tangobox.

By the way, do you know if there is any special configuration for these packages (apart TANGO basic configuration with TANGOHOST) ?

There is another way to create an openstack image, which consists into converting an existing VM to an openstack image, but I need access to OpenStack host network to use it.
I wait for this access to try this way.

- Philippe

Edited 8 years ago

# 8 years ago
Philippe	Philippe There is another way to create an openstack image, which consists into converting an existing VM to an openstack image, but I need access to OpenStack host network to use it. I wait for this access to try this way. The image of tangobox is 18Gb (100Gb uncompressed). The image I got by converting it into openstack image is 17Gb (and 100Gb uncompressed also). This is far too big for the policy of the cloud we use (the philosophy is to have small images for system and to store date on persistent disks). Besides this point, I noticed that uncompressed image of tangobox is 107Gb (you can see it into VM details, into "storage", next to tango92-vm.vdi). However, into the VM, I got these informations which does not seem consistent : tango-cs@tango9-vm:~$ sudo fdisk -l [sudo] password for tango-cs: Disk /dev/sda: 107.4 GB, 107374182400 bytes 255 heads, 63 sectors/track, 13054 cylinders, total 209715200 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x729dd433 Device Boot Start End Blocks Id System /dev/sda1 * 2048 80001023 39999488 83 Linux /dev/sda2 80003070 104855551 12426241 5 Extended /dev/sda5 80003072 104855551 12426240 82 Linux swap / Solaris `tango-cs@tango9-vm:~$ sudo parted GNU Parted 2.3 Using /dev/sda Welcome to GNU Parted! Type 'help' to view a list of commands. (parted) print Model: ATA VBOX HARDDISK (scsi) Disk /dev/sda: 107GB Sector size (logical/physical): 512B/512B Partition Table: msdos Number Start End Size Type File system Flags 1 1049kB 41,0GB 41,0GB primary ext4 boot 2 41,0GB 53,7GB 12,7GB extended 5 41,0GB 53,7GB 12,7GB logical linux-swap(v1)` It seems strange that total VM size is 107Gb but the space detected inside the VM is only half this size (53,7Gb). Perhaps some lost space could be saved here… Whatever, because of this size issue, I have to create an OpenStack VM from scratch. To do this, I need not only the list of packages I already found (see above) but also the list of configuration steps to follow to create the VM. I imagine the creation of the tangobox VM used a script (including the ubuntu used distribution, possible /etc/apt/sources.list changes, config steps with debconf-set-selections, manual steps for soft like eclipse…). Is this script available somewhere ? Actually, I tried to install an OpenStack tangobox VM based on an ubuntu 14.04.4 LTS (ubuntu-14.04.4-desktop-amd64.iso), by importing packages sources from tangobox92-RC1, replacing sources.list by the one from tangobox, updating database, and installing the packages list I got from the tangobox92-RC1. However, somes additional configuration steps are needed to install an openstack tangobox the same way as the virtualbox was installed. The installation cannot succeed without theses steps. Does anyone knows who create the tangobox? And is there any script (or descriptions of the installation/configuration steps) to create this one? Thank you - Philippe Edited 8 years ago

# 8 years ago

Philippe

Philippe
There is another way to create an openstack image, which consists into converting an existing VM to an openstack image, but I need access to OpenStack host network to use it.
I wait for this access to try this way.

The image of tangobox is 18Gb (100Gb uncompressed).
The image I got by converting it into openstack image is 17Gb (and 100Gb uncompressed also).
This is far too big for the policy of the cloud we use (the philosophy is to have small images for system and to store date on persistent disks).

Besides this point, I noticed that uncompressed image of tangobox is 107Gb (you can see it into VM details, into "storage", next to tango92-vm.vdi).
However, into the VM, I got these informations which does not seem consistent :

tango-cs@tango9-vm:~$ sudo fdisk -l
[sudo] password for tango-cs: 

Disk /dev/sda: 107.4 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders, total 209715200 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x729dd433

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *        2048    80001023    39999488   83  Linux
/dev/sda2        80003070   104855551    12426241    5  Extended
/dev/sda5        80003072   104855551    12426240   82  Linux swap / Solaris

tango-cs@tango9-vm:~$ sudo parted
GNU Parted 2.3
Using /dev/sda
Welcome to GNU Parted! Type 'help' to view a list of commands.
(parted) print                                                            
Model: ATA VBOX HARDDISK (scsi)
Disk /dev/sda: 107GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos

Number  Start   End     Size    Type      File system     Flags
 1      1049kB  41,0GB  41,0GB  primary   ext4            boot
 2      41,0GB  53,7GB  12,7GB  extended
 5      41,0GB  53,7GB  12,7GB  logical   linux-swap(v1)

It seems strange that total VM size is 107Gb but the space detected inside the VM is only half this size (53,7Gb).
Perhaps some lost space could be saved here…

Whatever, because of this size issue, I have to create an OpenStack VM from scratch.
To do this, I need not only the list of packages I already found (see above) but also the list of configuration steps to follow to create the VM.

I imagine the creation of the tangobox VM used a script (including the ubuntu used distribution, possible /etc/apt/sources.list changes, config steps with debconf-set-selections, manual steps for soft like eclipse…).
Is this script available somewhere ?

Actually, I tried to install an OpenStack tangobox VM based on an ubuntu 14.04.4 LTS (ubuntu-14.04.4-desktop-amd64.iso), by importing packages sources from tangobox92-RC1, replacing sources.list by the one from tangobox, updating database, and installing the packages list I got from the tangobox92-RC1.
However, somes additional configuration steps are needed to install an openstack tangobox the same way as the virtualbox was installed. The installation cannot succeed without theses steps.

Does anyone knows who create the tangobox? And is there any script (or descriptions of the installation/configuration steps) to create this one?

Thank you

- Philippe

Edited 8 years ago