Home networking issue

My Virtual Machines crashes sometimes and I think something is missing or is misconfigured in my network. Is there anything wrong with my infrastructure?

My server is an Ubuntu install with 3 NIC.

enp2s0 = LAN, 10.0.0.X, dhcp from pfsense. Used for server access and server Internet access.
enp5s0 = LAN, same network as first nic. This is dedicated to VMs. Access and Internet.
enp6s0 = Static IP, 10.10.10.X, another subnet with a single cable directly to Freenas machine, used for iSCSI, VM disk.

My network is managed by pfsense. I have a seperate Freenas box with two NIC. One for the network and the other with a direct cable to enp6s0. I have not added any extra routing or gateways.

Server are running KVM with 5 guests.

slicemenice@monkey:~$ ifconfig

Summary

enp2s0 Link encap:Ethernet HWaddr 4c:cc:6a:00:0d:e6
inet addr:10.0.0.57 Bcast:10.0.255.255 Mask:255.255.0.0
inet6 addr: fe80::1035:3406:6838:a4f8/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:4709 errors:0 dropped:0 overruns:0 frame:0
TX packets:3398 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:940694 (940.6 KB) TX bytes:322647 (322.6 KB)

enp5s0 Link encap:Ethernet HWaddr c4:6e:1f:00:63:1e
inet6 addr: fe80::c66e:1fff:fe00:631e/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:40224 errors:0 dropped:0 overruns:0 frame:0
TX packets:36108 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:4648904 (4.6 MB) TX bytes:3316742 (3.3 MB)
Interrupt:16 Memory:f7dc0000-f7de0000

enp6s0 Link encap:Ethernet HWaddr c4:6e:1f:00:63:1e
inet addr:10.10.10.57 Bcast:10.10.10.255 Mask:255.255.255.0
inet6 addr: fe80::c66e:1fff:fe00:631e/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:9000 Metric:1
RX packets:406554 errors:0 dropped:0 overruns:0 frame:0
TX packets:212259 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1422702155 (1.4 GB) TX bytes:354590735 (354.5 MB)

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:322 errors:0 dropped:0 overruns:0 frame:0
TX packets:322 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1
RX bytes:25764 (25.7 KB) TX bytes:25764 (25.7 KB)

macvtap0 Link encap:Ethernet HWaddr 52:54:00:d9:be:1e
inet6 addr: fe80::5054:ff:fed9:be1e/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1322 errors:0 dropped:0 overruns:0 frame:0
TX packets:32 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:239641 (239.6 KB) TX bytes:6380 (6.3 KB)

macvtap1 Link encap:Ethernet HWaddr 52:54:00:4e:83:95
inet6 addr: fe80::5054:ff:fe4e:8395/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:2083 errors:0 dropped:0 overruns:0 frame:0
TX packets:1039 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:1208145 (1.2 MB) TX bytes:111511 (111.5 KB)

macvtap2 Link encap:Ethernet HWaddr 52:54:00:4a:ba:fb
inet6 addr: fe80::5054:ff:fe4a:bafb/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:2160 errors:0 dropped:0 overruns:0 frame:0
TX packets:1075 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:596639 (596.6 KB) TX bytes:100960 (100.9 KB)

macvtap3 Link encap:Ethernet HWaddr 52:54:00:9f:3f:bb
inet6 addr: fe80::5054:ff:fe9f:3fbb/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:3418 errors:0 dropped:0 overruns:0 frame:0
TX packets:3272 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:588663 (588.6 KB) TX bytes:899059 (899.0 KB)

macvtap4 Link encap:Ethernet HWaddr 52:54:00:82:90:cd
inet6 addr: fe80::5054:ff:fe82:90cd/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:11625 errors:0 dropped:0 overruns:0 frame:0
TX packets:5585 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:1243619 (1.2 MB) TX bytes:527003 (527.0 KB)

macvtap5 Link encap:Ethernet HWaddr 52:54:00:39:c3:e6
inet6 addr: fe80::5054:ff:fe39:c3e6/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:28533 errors:0 dropped:0 overruns:0 frame:0
TX packets:28942 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:1944864 (1.9 MB) TX bytes:1698804 (1.6 MB)

virbr0 Link encap:Ethernet HWaddr 00:00:00:00:00:00
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

nano /etc/network/interfaces

Summary

#interfaces(5) file used by ifup(8) and ifdown(8)
auto lo
iface lo inet loopback
auto enp5s0
iface enp5s0 inet manual
hwaddress ether c4:6e:1f:00:63:1e

#Added
auto enp6s0
iface enp6s0 inet static
address 10.10.10.57
netmask 255.255.255.0
network 10.10.10.0/24
broadcast 10.10.10.255
mtu 9000

slicemenice@monkey:~$ df -h

Summary

Filesystem Size Used Avail Use% Mounted on
udev 7,8G 0 7,8G 0% /dev
tmpfs 1,6G 9,6M 1,6G 1% /run
/dev/sda1 95G 37G 53G 42% /
tmpfs 7,8G 176K 7,8G 1% /dev/shm
tmpfs 5,0M 4,0K 5,0M 1% /run/lock
tmpfs 7,8G 0 7,8G 0% /sys/fs/cgroup
cgmfs 100K 0 100K 0% /run/cgmanager/fs
tmpfs 1,6G 80K 1,6G 1% /run/user/1000
/dev/sdc1 1008G 332G 626G 35% /mnt/Disk

slicemenice@monkey:~$ nano /etc/fstab

Summary

#/etc/fstab: static file system information.

#Use ‘blkid’ to print the universally unique identifier for a
#device; this may be used with UUID= as a more robust way to name devices
#that works even if disks are added and removed. See fstab(5).

#
#/ was on /dev/sda1 during installation
UUID=a469f324-f07c-4969-99c8-c2fd608754af / ext4 errors=remount-ro 0 1
#swap was on /dev/sda5 during installation
UUID=98a57b4a-f6ef-4bcc-acb6-9bc96b85d3ec none swap sw 0 0

#This created a crash…
#/dev/sdc1 /media/slicemenice/iscsi ext4 defaults 0 1
#Testing a new one

#iSCSI
UUID=af639c5a-ae31-4c15-9e05-5554accda4be /mnt/Disk auto nosuid,nodev,nofail,x-gvfs-show 0 0

#500 GB
#UUID=23754ff4-40ed-450e-8679-18dfe65821e5 /mnt/Disk auto nosuid,nodev,nofail,x-gvfs-show 0 0

Freenas network picture.

Summary

Ouch. Sorry for the messy formating in text. I’m new here…

Does your VM guest have some kind of log that would give a hint as to why it “crashed”?

Not sure where to look (Ubuntu servers)… Im almost sure that it relates to their disk (iSCSI). I have another VM on a physical disk which are all fine when the rest crashes/freezes. When it happens Freenas says:

freenas ctld[22717]: 10.10.10.57 (iqn.2005-10-org.freenas.ctl:slicemenice): read: connection lost

and

WARNING: 10.10.10.57 (iqn.2005-10-org.freenas.ctl:slicemenice): no ping reply (NOP-Out) after 5 seconds; dropping connection
WARNING: 10.10.10.57 (iqn.2005-10-org.freenas.ctl:slicemenice): waiting for CTL to terminate 23 tasks
WARNING: 10.10.10.57 (iqn.2005-10-org.freenas.ctl:slicemenice): tasks terminated
WARNING: 10.10.10.57 (iqn.2005-10-org.freenas.ctl:slicemenice): no ping reply (NOP-Out) after 5 seconds; dropping connection
WARNING: 10.10.10.57 (iqn.2005-10-org.freenas.ctl:slicemenice): waiting for CTL to terminate 23 tasks
WARNING: 10.10.10.57 (iqn.2005-10-org.freenas.ctl:slicemenice): tasks terminated