sleep_time_check.py failed to parse suspend/resume time

Bug #1988521 reported by jeremyszu
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Checkbox Provider - Base
Expired
High
Pierre Equoy
OEM Priority Project
New
Undecided
Unassigned

Bug Description

[Description]
sleep_time_check.py failed to parse

    # find our times
    for line in lines:
        try:
            if "Average time to sleep" in line:
                sleep_time = float(line.split(':')[1].strip())
                sleep_times.append(sleep_time)
            elif "Average time to resume" in line:
                resume_time = float(line.split(':')[1].strip())
                resume_times.append(resume_time)
        except ValueError as e:
            print("ERROR: One or more times was not reported correctly:")
            print(e)
            return 1

I guess the "Average time to sleep/resume" likely missing or showing unexpected output.
In the failure case, the checkbox submission doesn't include "pm_test.reboot.3.log".
Thus, we won't know what's going on.

[Summary]
power-management/suspend-30-cycles-time-check-with-reboots test failed

[Steps to reproduce]
Run checkbox-cli stress test

[Checkbox job `com.canonical.certification::power-management/suspend-30-cycles-time-check-with-reboots` output]

stdout
------
ERROR: One or more times was not reported correctly:
could not convert string to float: 'N/A'

jeremyszu (os369510)
tags: added: oem-priority originate-from-1981804 somerville
tags: added: originate-from-1950728 stella
tags: added: originate-from-1950737
tags: added: originate-from-1970877
Changed in plainbox-provider-checkbox:
importance: Undecided → High
status: New → Confirmed
assignee: nobody → jeremyszu (os369510)
jeremyszu (os369510)
tags: added: originate-from-1950729
Scott Hu (huntu207)
tags: added: ce-qa-concern
Revision history for this message
Pierre Equoy (pieq) wrote :

I suspect the logs generated by fwts_test.py spit out "N/A", and it makes checking the time impossible:

https://github.com/canonical/checkbox/blob/main/checkbox-support/checkbox_support/scripts/fwts_test.py#L128-L130

I will need to run this on an actual device and capture the logs to see what's the content of the file before being processed.

We see this error more and more, so I think this is important to get fixed.

Changed in plainbox-provider-checkbox:
milestone: none → 0.66.0
Pierre Equoy (pieq)
Changed in plainbox-provider-checkbox:
assignee: jeremyszu (os369510) → Pierre Equoy (pieq)
Revision history for this message
Pierre Equoy (pieq) wrote :

Discussed with QA:

- Investigate why FWTS/pm_test is spitting much more "N/A" than in the past. Could be an issue with FWTS
- Modify Checkbox script to:
    - report how many correct cycle times (and their average)
    - report how many "N/A"
    - fail the test and provide above info so that QA engineer can take a look and take action

Pierre Equoy (pieq)
Changed in plainbox-provider-checkbox:
milestone: 2.0.0 → 2.1.0
Revision history for this message
Maksim Beliaev (beliaev-maksim) wrote :

Bug was migrated to GitHub: https://github.com/canonical/checkbox/issues/99.
Bug is no more monitored here.

Changed in plainbox-provider-checkbox:
status: Confirmed → Expired
jeremyszu (os369510)
tags: added: originate-from-1999908
tags: added: originate-from-1999916
tags: added: originate-from-1999918
tags: added: originate-from-1999919
tags: added: originate-from-1999923
tags: added: originate-from-1999927
jeremyszu (os369510)
tags: added: originate-from-2008204
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.