Tuesday, 19 September 2017

Deep Learning HOWTO with IBM Minsky Power8 server, Ubuntu 16.04, Caffe-NV and Kitti (Part 1)

Who should be reading this

This document is suited to anyone who wants to start testing deep learning in a supercomputer scale with an IBM Minsky server.
It will help installing all the latest and greatest components of this solution and then will help to run an example of deep learning as KITTI test is.

Justification of the document

You can follow IBM official doc (located here →https://www-01.ibm.com/common/ssi/cgi-bin/ssialias?htmlfid=POO03514WWEN ) to install the components necessary run this test.

However if you want the latest and greatest versions of all SW components you will find here a quick guide to install all of them with examples included

Ubuntu 16.04.02 OS installation

# Download Ubuntu 16.04.02 LTS from this URL (check if there is something newer)

# Burn the ISO into a USB drive and boot the system.

# Select the 4.4 kernel as in the photo (be aware that you may be presented with the option of installing HWE (shipped with kernel version 4.8. This is not supported at the time of writing this doc).

# Install only ssh and base packages.

# After first boot check the output is kernel 4.4 (not 4.8)

root@minsky:~# uname -a
Linux minsky 4.4.0-62-generic #83-Ubuntu SMP Wed Jan 18 14:09:19 UTC 2017 ppc64le ppc64le ppc64le GNU/Linux

# Keep the IP address/es to access later via ssh.

root@minsky:/sw/dw# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enP9p7s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 70:e2:84:14:25:fe brd ff:ff:ff:ff:ff:ff
    inet brd scope global enP9p7s0f0
       valid_lft forever preferred_lft forever
    inet6 fe80::72e2:84ff:fe14:25fe/64 scope link 
       valid_lft forever preferred_lft forever
3: enP9p7s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 70:e2:84:14:25:ff brd ff:ff:ff:ff:ff:ff
    inet brd scope global enP9p7s0f1
       valid_lft forever preferred_lft forever
    inet6 fe80::72e2:84ff:fe14:25ff/64 scope link 
       valid_lft forever preferred_lft forever

No comments:

Flying in the AVE