canonical-certification-server from checkbox-dev still won't run the iperf tests

Bug #1300836 reported by Kent Baxley
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Provider for Plainbox - Canonical Certification (Legacy)
Fix Released
High
Daniel Manrique

Bug Description

I've been trying to get the iperf settings and tests to run / be honored using the checkbox-ng and plainbox-provider-certification-server packages to address this bug:

https://bugs.launchpad.net/checkbox/+bug/1296965

Here are the versions installed on my SUT's. These are *clean* installs:

0.3~dev+bzr2853+pkg1~ubuntu14.04.1

0.1~dev+bzr2853+pkg3~ubuntu14.04.1

0.6~dev+bzr2858+pkg2~ubuntu14.04.1

My /etc/xdg/certification.conf file looks like this...is there anything I need to be doing differently?:

[common]
welcome_text = Welcome to System Certification!

 This application will gather information from your system. Then you will be asked manual tests to confirm that the syst$

 To learn how to create or locate the Secure ID, please see here:

 https://certification.canonical.com/home/ubuntu-certified

[environment]
# For virtualization testing.
# Uncomment the following 2 lines and set the proper parameters:
#KVM_TIMEOUT =
#KVM_IMAGE =
# For network testing.
# Uncomment the following 4 lines and set the proper parameters:
TEST_TARGET_FTP = your-ftp-server.example.com
TEST_USER = anonymous
TEST_PASS =
TEST_TARGET_IPERF = 10.0.0.1

[sru]
SECURE_ID = a00D000000N6J1V

None of the above settings seems to be getting honored. Two others have reported success and I can run the iperf tests by hand with no problem (i.e. iperf -c 10.0.0.1 -n1024M).

Related branches

Revision history for this message
Kent Baxley (kentb) wrote :

$ canonical-certification-server --check-config
Configuration files:
 - /etc/xdg/plainbox.conf (not present)
 - /etc/xdg/checkbox.conf (not present)
 - /etc/xdg/canonical-certification.conf
 - /home/ubuntu/.config/plainbox.conf (not present)
 - /home/ubuntu/.config/checkbox.conf (not present)
 - /home/ubuntu/.config/canonical-certification.conf (not present)
Variables:
   welcome_text=Welcome to System Certification!

This application will gather information from your system. Then you will be asked manual tests to confirm that the system is working properly. Finally, you will be asked for the Secure ID of the computer to submit the information to the certification.canonical.com database.

To learn how to create or locate the Secure ID, please see here:

https://certification.canonical.com/home/ubuntu-certified
   default_provider=all
   secure_id=unset
   c3_url=https://certification.canonical.com/submissions/submit/
   fallback_file=unset
   whitelist=unset
Sections:
   environment={'TEST_TARGET_IPERF': '10.0.0.1', 'TEST_USER': 'anonymous', 'TEST_PASS': '', 'TEST_TARGET_FTP': 'your-ftp-server.example.com'}
No validation problems found

Revision history for this message
Daniel Manrique (roadmr) wrote :

OK, there are two issues with the configuration (both are non-obvious, apologies, I'll see if there's a way to mitigate that). And an actual bug with the whitelist :)

First, the SECURE_ID setting needs to be lowercase, so:

[sru]
secure_id=mumblemumble

Second, the network script needs ALL values to be passed to it. Since you're leaving TEST_PASS blank, it'll probably not want to run correctly. Just set TEST_PASS to something (a@b.com is what I used in the old anonymous ftp days, if that's what you have).

I'll update the config file template to guide users through this set of finicky options.

And finally (Another action item here). On your system the network interfaces look like this:

path: /devices/pci0000:00/0000:00:1c.0/0000:05:00.0
bus: pci
category: NETWORK
driver: tg3
product_id: 5727
vendor_id: 5348
product: NetXtreme BCM5720 Gigabit Ethernet PCIe
vendor: Broadcom Corporation
interface: em1

Notice the interface name is em1, so the generated jobs will look like

ethernet/multi_nic_em1

however, the whitelist has this:
ethernet/multi_nic
ethernet/multi_nic_eth\d

So the subjobs will clearly not match and never run :(

This explains why my simplistic "it runs here!" verification was bogus since of course on my consumer-level equipment I have ethX interfaces. Also explains why "plainbox run -i ethernet/multi_nic_.*" worked, because I wasn't replicating the eth.* restriction.

I'll update the whitelist to better catch these network interface names.

Changed in checkbox:
status: New → In Progress
importance: Undecided → High
milestone: none → 2014-apr-11
Daniel Manrique (roadmr)
Changed in checkbox:
assignee: nobody → Daniel Manrique (roadmr)
Zygmunt Krynicki (zyga)
affects: checkbox → plainbox-provider-canonical-certification
Changed in plainbox-provider-canonical-certification:
milestone: 2014-apr-11 → none
status: In Progress → Fix Committed
Changed in plainbox-provider-canonical-certification:
milestone: none → 0.1
Changed in plainbox-provider-canonical-certification:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.