HUD is silent to screen readers

Bug #949445 reported by Alan Bell
28
This bug affects 4 people
Affects Status Importance Assigned to Milestone
Unity
Fix Released
Undecided
Unassigned
unity-2d
Fix Released
Medium
Paweł Stołowski
unity (Ubuntu)
Confirmed
Undecided
Unassigned
Precise
Won't Fix
Undecided
Unassigned
unity-2d (Ubuntu)
Fix Released
Undecided
Unassigned
Precise
Fix Released
Medium
Bartosz Kosiorek

Bug Description

Test case:
1. Enable accessibility and the orca screen reader
2. Relog into Unity-2D
3. Open any application
4. Make the HUD appear (tap Alt)
5. Enter any search that returns some results
6. Move around the results with arrow keys
   -> The orca reader should read the suggestions

===

HUD is broken for users of orca, it does not speak the suggestions. In unity2d all the suggestions are spoken as pushbuttons but not the values of them.

Related branches

Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in indicator-appmenu (Ubuntu):
status: New → Confirmed
tags: added: a11y
Luke Yelavich (themuso)
affects: indicator-appmenu (Ubuntu) → unity (Ubuntu)
Changed in unity-2d (Ubuntu):
status: New → Confirmed
Gerry Boland (gerboland)
Changed in unity-2d:
status: New → Confirmed
milestone: none → 5.8
importance: Undecided → Medium
assignee: nobody → Gerry Boland (gerboland)
status: Confirmed → In Progress
Gerry Boland (gerboland)
Changed in unity-2d:
status: In Progress → Fix Committed
Changed in unity:
status: New → Fix Released
Changed in unity-2d:
status: Fix Committed → Fix Released
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package unity-2d - 5.8.0-0ubuntu1

---------------
unity-2d (5.8.0-0ubuntu1) precise-proposed; urgency=low

  * New upstream release
    - Loss of DBus connection with active Dash/Hud results in broken panel
      (LP: #953168)
    - [launcher] super key and number from _keypad_ doesn't work (LP: #750514)
    - [dash] Home lens state not reset if dash closed & reopened (LP: #948299)
    - HUD is silent to screen readers (LP: #949445)
    - Use title case capitalization "Lock to Launcher" & "Unlock from
      Launcher" (LP: #949636)
    - tiles highlight incorrect, highlight only visible at edge (LP: #953403)
    - [UIFe] Use average color of wallpaper to tint launcher/dash/panel/hud
      (LP: #960194)
  * debian/control:
    - build-dep on latest nux and unity-core
 -- Didier Roche <email address hidden> Fri, 23 Mar 2012 15:33:38 +0100

Changed in unity-2d (Ubuntu):
status: Confirmed → Fix Released
Revision history for this message
Attila Hammer (hammera) wrote :

Unfortunately in unity-2d 5.10.0-0ubuntu1 version HUD is again not work with screen reader.
I now tested with Orca master version, now following happening:
1. If I press ALT key, Orca only spokening following output: HUD pane
2. If I type a search term, nothing happening.
In Unity-2d 5.8.0-0ubuntu1 version HUD works perfect.

Attila

Revision history for this message
Albert Astals Cid (aacid) wrote :

Reopening as per Attila comment

Changed in unity-2d:
status: Fix Released → New
assignee: Gerry Boland (gerboland) → nobody
Revision history for this message
Paweł Stołowski (stolowski) wrote :

Confirming, we have regression here. This is related to the latest focus/highlight changes in Hud. Unfortunately these focus changes seem right and were implemented to fix some specific problems we had with Hud. We may need to develop a custom python script for Orca to handle unity-2d-shell a11y events.

Changed in unity-2d:
milestone: 5.8 → 5.12
Gerry Boland (gerboland)
Changed in unity-2d:
status: New → Confirmed
Revision history for this message
Attila Hammer (hammera) wrote : Re: [Bug 949445] Re: HUD is silent to screen readers

If this Orca custom script are done, have chance to land in Precise
gnome-orca 3.4 series package with downstream level?

If need help the testing with Orca, I welcome help.
I report this issue in Bugzilla with Orca master branch related and
attach upstream level an Orca debug.out file?
When scheduled the Unity 5.12 release?

Attila

Revision history for this message
Attila Hammer (hammera) wrote :

Hy,

I attaching two file:
1. A listener Python script with Joanie doed.
2. The output log when I try using HUD with Orca.
This is not a full Orca debug file.
I doed following:
1. Run the listener script.
2. Press ALT key, and typed the leá string. In hungarian locale prewious
Orca spokened me I land the leállítás result (shutdown result in english).
3. Try press ENTER key. HUD right activated the shutdown dialog.
A very interesting thing the output log:
First time right focused the HUD text related label, but short time
focused an another object, with named panel | Hud.
I will be make an Orca debug.out file to see what happening.

Attila

Revision history for this message
Attila Hammer (hammera) wrote :
  • debug.out Edit (482.7 KiB, text/plain; charset=UTF-8; name="debug.out")

This is an Orca debug.out file.

Attila

Revision history for this message
Paweł Stołowski (stolowski) wrote :

Thanks Attila. Custom script for Orca was a dead end and the main reason is all HUD results were sent as new children events, but moving over them was only producing regular input events (Up/Down keys), without context. I'm re-visiting our hud focus handling.

Changed in unity-2d:
assignee: nobody → Pawel Stolowski (stolowski)
status: Confirmed → In Progress
Revision history for this message
Attila Hammer (hammera) wrote :

Pavel, when you working HUD focus handling, possible trying fix
following issue?
When an application HUD founding a dialogue presenting menu item, if I
try press ENTER key the selected search result, the activated dialogue
is not focused automaticaly.
An example reproducation steps:
1. Launch Gedit.
2. If you use english locale, press ALT key, and type prefe string.
HUD right presenting the edit menu preferences menu item. When you press
ENTER key, need press an ALT+F6 key combination to get focus the already
activated preferences dialog.
I reported this issue with bug 976393 report, and reproducable the issue
in unity-2d 5.10.

Attila

Changed in unity-2d:
status: In Progress → Fix Committed
description: updated
Changed in unity-2d:
status: Fix Committed → Fix Released
Revision history for this message
Martin Pitt (pitti) wrote : Please test proposed package

Hello Alan, or anyone else affected,

Accepted unity-2d into precise-proposed. The package will build now and be available in a few hours. Please test and give feedback here. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you in advance!

Changed in unity-2d (Ubuntu Precise):
status: New → Fix Committed
tags: added: verification-needed
Revision history for this message
Attila Hammer (hammera) wrote : Re: [Bug 949445] Re: HUD is silent to screen readers

Martin, my test results is following:
HUD works right again after upgrade. I only experienced with following
issues:
1. If I write a search term and want exiting with HUD, need press two
escape key.
2. If I launch for example Gedit, use HUD to found a menu item and
exiting with HUD, some time impossible to moving the typed Gedit text
content until I not activate and deactivated main menu. Before I doing
this, my braille display I think I see "result list" or similar text.
Launcher, dash, menues activation works fine.
Alan, you experienced similar results?

Attila

Changed in unity-2d (Ubuntu Precise):
importance: Undecided → Medium
assignee: nobody → Bartosz Kosiorek (gang65)
tags: added: verification-done
removed: verification-needed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package unity-2d - 5.12.0-0ubuntu1

---------------
unity-2d (5.12.0-0ubuntu1) precise-proposed; urgency=low

  * New upstream release:
    - unity-2d-shell crashed with SIGSEGV in ref() (LP: #968046)
    - [hud] First entry always activated with keyboard navigation
      (LP: #980899)
    - unity-2d-shell crashes on autoscrolling on launcher tile removal
      (LP: #988239)
    - unity-2d-shell crashes when using with a NX server (LP: #983942)
    - Dash - update Dash keyboard shortcuts so the 'CTRL + TAB' switches
      between Lenses and 'TAB' by itself moves the focus between categories
      (LP: #891648)
    - [spread] When multiple windows of an app are open, clicking on one
      doesn't bring it to the foreground (LP: #917334)
    - [HUD][multi-monitor] HUD should be expanded to the left if used on a
      screen without launcher (LP: #979927)
    - unity-2d scope un-url-escapes values from its model (LP: #986175)
    - [places] tab key does nothing (LP: #891565)
    - HUD is silent to screen readers (LP: #949445)
    - launcher background coloring does not get reset when using enter to
      activate/start a program (LP: #965079)
    - [multi-monitor] [launcher] Drag & drop application to launcher on
      primary screen, other launchers not updated (LP: #966239)
    - HUD gets activated by Thinkpad USB Keyboard's back and forward buttons
      (LP: #968840)
    - Unity 2D doesn't load 24 bit icons (LP: #977262)
    - Four finger tap does not open the Dash (LP: #978659)
    - No icon in launcher entry, after installing software (LP: #980640)
    - Menu items displayed incorrectly when window streched over multiples
      monitors (LP: #987215)
    - [unity-2d-panel] The close button (potentially the others too) can
      toggled even when they are not visible anymore (LP: #924264)
    - When closing the Dash with the [x] panel button the last windows is not
      focused and doesn't allow to use window controls. (LP: #945459)
    - [launcher] item hint flickers when hovering between launcher edge and
      item (LP: #948383)
    - Missaligned progress bar (LP: #980609)
    - Launcher tile tooltip appears in wrong screen in RTL multimonitor setups
      (LP: #984080)
 -- Didier Roche <email address hidden> Fri, 27 Apr 2012 09:32:40 +0200

Changed in unity-2d (Ubuntu Precise):
status: Fix Committed → Fix Released
Revision history for this message
Alex Baggott (alex-baggott) wrote :

As part of the big bug review for 16.04 LTS, I have tested this on 15.10 and the bug is still there.

Although 15.10 doesn't have Unity 2D, HUD results are not spoken by Orca in regular Unity.

tags: added: desktop-bugscrub-triaged
Revision history for this message
Steve Langasek (vorlon) wrote :

The Precise Pangolin has reached end of life, so this bug will not be fixed for that release

Changed in unity (Ubuntu Precise):
status: New → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.