Trema-edge + OVSでOpenFlow1.3テスト環境を作る
はじめに
そろそろ OpenFlow 1.3 なテストをやってみたいなあと思ったので Trema-edge のビルドと KVM + Open vSwitch でのテスト環境の構築をやってみた。といっても、Trema-edge でサンプル (learning-switch) が動くってところまで。
環境と下準備
- Controller
- KVM Host
KVM Host の方は Ubuntu/KVM/OVSでOpenFlowテスト環境をつくる(7) で使った物で、OVS はソースからビルドしてあります。以下、Controller 側のセットアップ手順を主に記載。
Ruby2.0の準備
trema/trema-edge の README を見ながらセットアップを進めるのですが、まず Ruby2.0 のインストールをします。
This repository has only been tested with ruby 2.0.0 (maybe with 1.9.3) and will not work with 1.8.x. We recommend installation of the rvm program for easy installation of ruby 2.0.0.
Ubuntu 13.04 だと ruby-1.9.3 までは apt-get してインストールできるのですが、README の推奨に従って rvm を使ってインストールしていきます。
RVM のインストール
参照
RVM は curl を使ってインストールされるので、curl がインストールされていることを確認します。(既に入っていた)
stereocat@vnwt10ctrl-of13:~$ which curl /usr/bin/curl stereocat@vnwt10ctrl-of13:~$ curl --version curl 7.29.0 (x86_64-pc-linux-gnu) libcurl/7.29.0 OpenSSL/1.0.1c zlib/1.2.7 libidn/1.25 librtmp/2.3 Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp smtp smtps telnet tftp Features: GSS-Negotiate IDN IPv6 Largefile NTLM NTLM_WB SSL libz TLS-SRP stereocat@vnwt10ctrl-of13:~$
RVM: Ruby Version Manager - RVM Ruby Version Manager - Documentation に書いてある手順で rvm のインストール実行。
stereocat@vnwt10ctrl-of13:~$ curl -L https://get.rvm.io | bash -s stable
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 184 100 184 0 0 73 0 0:00:02 0:00:02 --:--:-- 318
100 14547 100 14547 0 0 3762 0 0:00:03 0:00:03 --:--:-- 25884
Downloading RVM from wayneeseguin branch stable
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 124 100 124 0 0 177 0 --:--:-- --:--:-- --:--:-- 181
100 1083k 100 1083k 0 0 46832 0 0:00:23 0:00:23 --:--:-- 10372
Installing RVM to /home/stereocat/.rvm/
Adding rvm PATH line to /home/stereocat/.bashrc /home/stereocat/.zshrc.
Adding rvm loading line to /home/stereocat/.bash_profile /home/stereocat/.zprofile.
Installation of RVM in /home/stereocat/.rvm/ is almost complete:
* To start using RVM you need to run `source /home/stereocat/.rvm/scripts/rvm`
in all your open shell windows, in rare cases you need to reopen all shell windows.
# stereocat,
#
# Thank you for using RVM!
# I sincerely hope that RVM helps to make your life easier and more enjoyable!!!
#
# ~Wayne
# In case of problems:
# run and read: rvm notes
# read docs: http://rvm.io/
# talk to us: http://webchat.freenode.net/?channels=rvm (http://freenode.net/faq.shtml#plusr)
# read cheatsheet: http://cheat.errtheblog.com/s/rvm
# watch screencast: http://screencasts.org/episodes/how-to-use-rvm
# open a bug report: https://github.com/wayneeseguin/rvm/issues
* WARNING: You have '~/.profile' file, you might want to load it,
to do that add the following line to '/home/stereocat/.bash_profile':
source ~/.profile
stereocat@vnwt10ctrl-of13:~$ユーザ別の環境を用意するために環境変数の設定とかが .bash_profile に追加されていたりします。
stereocat@vnwt10ctrl-of13:~$ cat .bash_profile [[ -s "$HOME/.rvm/scripts/rvm" ]] && source "$HOME/.rvm/scripts/rvm" # Load RVM into a shell session *as a function* stereocat@vnwt10ctrl-of13:~$
.profile とかの設定を追加しておけ、とか出てくるので入れておきます。
インストールできるパッケージのリストを表示
stereocat@vnwt10ctrl-of13:~$ rvm list known # MRI Rubies [ruby-]1.8.6[-p420] [ruby-]1.8.7[-p374] [ruby-]1.9.1[-p431] [ruby-]1.9.2[-p320] [ruby-]1.9.3[-p448] [ruby-]2.0.0-p195 [ruby-]2.0.0[-p247] [ruby-]2.0.0-head ruby-head (略)
ruby-2.0.0 (p247)をインストールします。
stereocat@vnwt10ctrl-of13:~$ rvm install ruby-2.0.0 (略) ruby-2.0.0-p247 - #validate archive ruby-2.0.0-p247 - #extract ruby-2.0.0-p247 - #validate binary ruby-2.0.0-p247 - #setup Saving wrappers to '/home/stereocat/.rvm/wrappers/ruby-2.0.0-p247'........ ruby-2.0.0-p247 - #importing default gemsets, this may take time....................... stereocat@vnwt10ctrl-of13:~$ stereocat@vnwt10ctrl-of13:~$ rvm list rvm rubies ruby-2.0.0-p247 [ x86_64 ] # Default ruby not set. Try 'rvm alias create default <ruby>'. # => - current # =* - current && default # * - default stereocat@vnwt10ctrl-of13:~$
デフォルトを設定しておけって書いてあるので設定。
tereocat@vnwt10ctrl-of13:~$ rvm alias create default ruby-2.0.0-p247 Creating alias default for ruby-2.0.0-p247. Recording alias default for ruby-2.0.0-p247. Creating default links/files Saving wrappers to '/home/stereocat/.rvm/bin'........ stereocat@vnwt10ctrl-of13:~$ stereocat@vnwt10ctrl-of13:~$ rvm list rvm rubies =* ruby-2.0.0-p247 [ x86_64 ] # => - current # =* - current && default # * - default stereocat@vnwt10ctrl-of13:~$
ruby のバージョン確認
stereocat@vnwt10ctrl-of13:~$ which ruby /home/stereocat/.rvm/bin/ruby stereocat@vnwt10ctrl-of13:~$ ruby -v ruby 2.0.0p247 (2013-06-27 revision 41674) [x86_64-linux] stereocat@vnwt10ctrl-of13:~$
trema-edge ビルドのためのパッケージ類をインストール
trema-edge README に従ってその他必要なパッケージ類を入れます。
stereocat@vnwt10ctrl-of13:~$ sudo apt-get install gcc make libsqlite3-dev libpcap-dev libssl-dev (略)
trema-edge のビルド
stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ gem install bundler (略) stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$
bundle install でコケる
stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ bundle install ERROR: RVM Ruby not used, run `rvm use ruby` first. stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ rvm use ruby ruby-2.0.0-p247 RVM is not a function, selecting rubies with 'rvm use ...' will not work. You need to change your terminal emulator preferences to allow login shell. Sometimes it is required to use `/bin/bash --login` as the command. Please visit https://rvm.io/integration/gnome-terminal/ for a example. stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$
RVM の環境変数設定の都合のようだ。(screen つかって shell 起動してるから)
stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ source ~/.bash_profile You are using '.rvmrc', it requires trusting, it is slower and it is not compatible with other ruby managers, you can switch to '.ruby-version' using 'rvm rvmrc to [.]ruby-version' or ignore this warning with 'rvm rvmrc warning ignore /home/stereocat/trema-orig/trema-edge/.rvmrc', '.rvmrc' will continue to be the default project file in RVM 1 and RVM 2, to ignore the warning for all files run 'rvm rvmrc warning ignore all.rvmrcs'. stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$
stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ bundle install (略) Your bundle is complete! Use `bundle show [gemname]` to see where a bundled gem is installed. Post-install message from reek: Thank you for downloading Reek. For info see the reek wiki http://wiki.github.com/troessner/reek stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$
ビルド実行
stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ rake | tee rake.log 2>&1 (略)
サンプルアプリでテスト
learning-switch を起動。
stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ ./trema run src/examples/learning_switch/learning-switch.rb -c src/examples/learning_switch/sample.conf
ホスト間通信の実行と確認。
stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ ./trema send_packets --source=host1 --dest=host2 stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ ./trema show_stats host1 Sent packets: ip_dst,tp_dst,ip_src,tp_src,n_pkts,n_octets 192.168.0.2,1,192.168.0.1,1,1,50 Received packets: stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$ ./trema show_stats host2 Sent packets: Received packets: ip_dst,tp_dst,ip_src,tp_src,n_pkts,n_octets 192.168.0.2,1,192.168.0.1,1,1,50 stereocat@vnwt10ctrl-of13:~/trema-orig/trema-edge$
Open vSwitch 設定
KVM Guest 用にブリッジ(br1)を作ります。
- Guest
- ofvm01, 192.168.11.21, tap1
- ofvm02, 192.168.11.22, tap2
root@vnwt11:~# sudo ovs-vsctl add-br br1
root@vnwt11:~# sudo ovs-vsctl set bridge br1 other-config:datapath-id=0000000000000011
root@vnwt11:~# sudo ovs-vsctl set bridge br1 protocols=OpenFlow13
root@vnwt11:~# sudo ovs-vsctl set-controller br1 tcp:192.168.1.90:6633
root@vnwt11:~# sudo ovs-vsctl show
6df77158-d02e-48dc-b81e-02551e12151b
Bridge "br0"
Port "br0"
Interface "br0"
type: internal
Port "eth0"
Interface "eth0"
Bridge "br1"
Controller "tcp:192.168.1.90:6633"
Port "tap2"
Interface "tap2"
Port "tap1"
Interface "tap1"
Port "br1"
Interface "br1"
type: internal
root@vnwt11:~#ovs-vsctl show では出てきていませんが、OVSDB 上にプロトコル指定が入ります。
root@vnwt11:~# ovs-vsctl list bridge
(略)
_uuid : 65445e5a-ddc6-488f-ac56-1cac61c21b25
controller : [9f711a8e-d1e4-410d-8dce-841850cb4dba]
datapath_id : "0000000000000011"
datapath_type : ""
external_ids : {}
fail_mode : []
flood_vlans : []
flow_tables : {}
ipfix : []
mirrors : []
name : "br1"
netflow : []
other_config : {datapath-id="0000000000000011"}
ports : [02c5f677-efbd-4392-8e88-225e11e3de21, 80250ddc-15ef-4512-a760-d1390c00b491, c37cb2f9-35a8-49a8-af13-1a5bf258a7c0]
protocols : ["OpenFlow13"]
sflow : []
status : {}
stp_enable : false
root@vnwt11:~#Controller (192.168.1.90) と接続してフロー情報を見てみます。
root@vnwt11:~# sudo ovs-ofctl dump-flows br1 2013-08-18T07:43:15Z|00001|vconn|WARN|unix:/usr/local/var/run/openvswitch/br1.mgmt: version negotiation failed (we support version 0x01, peer supports version 0x04) ovs-ofctl: br1: failed to connect to socket (Broken pipe) root@vnwt11:~#
…と、OpenFlow バージョンが違うって言われてしもた。プロトコル指定が必要。(これは Trema-edge/learning-switch Controller でホスト間通信 (ofvm01-ofvm02 間) を行ったときの状態。)
root@vnwt11:~# sudo ovs-ofctl dump-flows br1 --protocol=OpenFlow13 OFPST_FLOW reply (OF1.3) (xid=0x2): cookie=0x1, duration=182.155s, table=0, n_packets=18, n_bytes=1540, send_flow_rem priority=0 actions=CONTROLLER:65535 cookie=0x11, duration=69.399s, table=0, n_packets=0, n_bytes=0, send_flow_rem priority=0,icmp,in_port=1,dl_src=52:54:00:01:00:01,dl_dst=52:54:00:01:00:02,nw_src=192.168.11.21,nw_dst=192.168.11.22,nw_tos=0,nw_ecn=0,icmp_type=8,icmp_code=0 actions=output:2 cookie=0x12, duration=69.387s, table=0, n_packets=0, n_bytes=0, send_flow_rem priority=0,icmp,in_port=2,dl_src=52:54:00:01:00:02,dl_dst=52:54:00:01:00:01,nw_src=192.168.11.22,nw_dst=192.168.11.21,nw_tos=0,nw_ecn=0,icmp_type=0,icmp_code=0 actions=output:1 cookie=0xb, duration=87.5s, table=0, n_packets=0, n_bytes=0, send_flow_rem priority=0,arp,in_port=2,dl_src=52:54:00:01:00:02,dl_dst=52:54:00:01:00:01,arp_spa=192.168.11.22,arp_tpa=192.168.11.21,arp_op=1,arp_sha=52:54:00:01:00:02,arp_tha=00:00:00:00:00:00 actions=output:1 cookie=0x2, duration=92.576s, table=0, n_packets=0, n_bytes=0, send_flow_rem priority=0,arp,in_port=2,dl_src=52:54:00:01:00:02,dl_dst=52:54:00:01:00:01,arp_spa=192.168.11.22,arp_tpa=192.168.11.21,arp_op=2,arp_sha=52:54:00:01:00:02,arp_tha=52:54:00:01:00:01 actions=output:1 cookie=0xc, duration=87.488s, table=0, n_packets=0, n_bytes=0, send_flow_rem priority=0,arp,in_port=1,dl_src=52:54:00:01:00:01,dl_dst=52:54:00:01:00:02,arp_spa=192.168.11.21,arp_tpa=192.168.11.22,arp_op=2,arp_sha=52:54:00:01:00:01,arp_tha=52:54:00:01:00:02 actions=output:2 root@vnwt11:~#
OpenFlow Dissector をインストールする
Wireshark OpenFlow Dissector and TremaShark とかに書いていますが、これまでは
を使っていました。が、これ、OpenFlow/1.0 にしか対応してないんだよね。こんな感じになる。("Warning: Dissector written for OpenFlow v0x1)
で、探すと CPqD で OpenFlow 1.0-1.3 対応の Dissector が公開されているのでそっちを使います。
必要なソース類の準備。
stereocat@vnwt10ctrl-of13:~/trema-orig$ sudo apt-get install wireshark-dev libgtk2.0-dev scons (略) stereocat@vnwt10ctrl-of13:~/trema-orig$
Dissector のソース取得とビルド
stereocat@vnwt10ctrl-of13:~/trema-orig$ git clone https://github.com/CPqD/ofdissector.git (略) stereocat@vnwt10ctrl-of13:~/trema-orig$ cd ofdissector/src/ stereocat@vnwt10ctrl-of13:~/trema-orig/ofdissector/src$ ls of10 of11 of12 of13 openflow openflow-common.cpp openflow-common.hpp plugin.cpp Sconstruct util stereocat@vnwt10ctrl-of13:~/trema-orig/ofdissector/src$ export WIRESHARK=/usr/include/wireshark/ stereocat@vnwt10ctrl-of13:~/trema-orig/ofdissector/src$ scons install | tee scons-install.log 2>&1 scons: Reading SConscript files ... scons: done reading SConscript files. scons: Building targets ... g++ -o openflow-common.os -c -fPIC -I. -I/usr/include/wireshark -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include openflow-common.cpp In file included from openflow-common.cpp:9:0: ./of13/openflow-130.hpp:12:0: warning: "PROTO_TAG_OPENFLOW_VER" redefined [enabled by default] In file included from openflow-common.cpp:8:0: ./of12/openflow-120.hpp:13:0: note: this is the location of the previous definition g++ -o plugin.os -c -fPIC -I. -I/usr/include/wireshark -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include plugin.cpp g++ -o of10/openflow-100.os -c -fPIC -I. -I/usr/include/wireshark -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include of10/openflow-100.cpp g++ -o of11/openflow-110.os -c -fPIC -I. -I/usr/include/wireshark -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include of11/openflow-110.cpp g++ -o of12/openflow-120.os -c -fPIC -I. -I/usr/include/wireshark -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include of12/openflow-120.cpp g++ -o of13/openflow-130.os -c -fPIC -I. -I/usr/include/wireshark -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include of13/openflow-130.cpp g++ -o util/FieldManager.os -c -fPIC -I. -I/usr/include/wireshark -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include util/FieldManager.cpp g++ -o openflow.so -shared openflow-common.os plugin.os of10/openflow-100.os of11/openflow-110.os of12/openflow-120.os of13/openflow-130.os util/FieldManager.os -L/usr/lib -L/usr/local/lib Install file: "openflow.so" as "/home/stereocat/.wireshark/plugins/openflow.so" scons: done building targets. stereocat@vnwt10ctrl-of13:~/trema-orig/ofdissector/src$
Plugin の確認。packet-openflow.so が残っているけど、これは OF1.0 のみ対応のものなので消しておきます。
stereocat@vnwt10ctrl-of13:~/.wireshark/plugins$ ls -l total 604 -rwxrwxr-x 1 stereocat stereocat 422852 Aug 18 18:58 openflow.so -rw-r--r-- 1 stereocat stereocat 189961 Aug 18 17:03 packet-openflow.so stereocat@vnwt10ctrl-of13:~/.wireshark/plugins$
OVS-Controller(trema-edge/learning-switch) 間のキャプチャを取ってみるとこんな感じ。
おわりに
とりあえず Trema-edge が動くってところまで。動くと言ってもまだ learning-switch しか動かしてないけど。動くってことと、OpenFlow 通信の観測ってところまではできたので、あとは具体的なアプリ作ってみるってところに行けるかな−。そのまえに OF1.3 そのものの知識を入れておかねば…。
- 作者: あきみち,宮永直樹,岩田淳
- 出版社/メーカー: オーム社
- 発売日: 2013/07/26
- メディア: 単行本（ソフトカバー）
- この商品を含むブログ (5件) を見る
買ったんだけどまだ読んでないのでこの辺からかな…。
