Estoy tratando de automatizar algunas rutinas en MS Teams, pero me encontré con el problema de AppleScript no exponer todos los controles de estas aplicaciones.
tell application "System Events"
get entire contents of window "Chat | Microsoft Teams" of process "Teams"
end tell
Result:
{button 1 of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 2 of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 3 of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events"}Devuelve los botones close, min y max y ya está.
El inspector de accesibilidad tampoco rastrea los elementos individuales de la interfaz de usuario, mostrando toda la ventana como un RenderWidgetHostViewCocoa .
Me pareció extraño que una empresa tan respetable no se preocupara por el aliado de su producto, así que intenté usar VoiceOver (Cmd+F5) y ver si podía detectar elementos individuales de la ui. ¡Y lo hizo! Anuncia correctamente todos los elementos ui resaltados de Teams.
Lo que es aún más extraño es que después de habilitar VoiceOver mi AppleScript consiguió devolver todos los elementos que antes no veía.
tell application "System Events"
get entire contents of window "Chat | Microsoft Teams" of process "Teams"
end tell
Result:
{UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 2 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 2 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 1 of group 1 of group 2 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of button 1 of group 1 of group 2 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 2 of group 1 of group 2 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of button 2 of group 1 of group 2 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 3 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 3 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of group 3 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of group 1 of group 3 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of group 1 of group 1 of group 3 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", text field 1 of group 1 of group 1 of group 1 of group 1 of group 3 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of group 1 of group 1 of group 1 of group 3 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of group 1 of group 1 of group 1 of group 1 of group 3 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 4 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 4 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", pop up button 1 of group 1 of group 4 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of pop up button 1 of group 1 of group 4 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", pop up button 1 of group 4 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 2 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 3 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 3 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", checkbox 1 of group 1 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 2 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", checkbox 1 of group 2 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 3 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", checkbox 1 of group 3 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 4 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", checkbox 1 of group 4 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 5 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", checkbox 1 of group 5 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 6 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", checkbox 1 of group 6 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 7 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 7 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", pop up button 1 of group 1 of group 7 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of pop up button 1 of group 1 of group 7 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 8 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 8 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 9 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 9 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", checkbox 1 of group 1 of group 9 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 10 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", pop up button 1 of group 10 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of pop up button 1 of group 10 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", static text "Help" of pop up button 1 of group 10 of list 1 of group 1 of group 4 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", pop up button "Chat" of group 1 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of pop up button "Chat" of group 1 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", static text "Chat" of group 1 of pop up button "Chat" of group 1 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 2 of pop up button "Chat" of group 1 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 2 of pop up button "Chat" of group 1 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 1 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of button 1 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 2 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of button 2 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 2 of group 1 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 2 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 2 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of group 2 of group 2 of group 2 of group 5 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 1 of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", static text "Have private conversations Sometimes you just want to chat or video call privately one-on-one or with a group." of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", UI element 1 of static text "Have private conversations Sometimes you just want to chat or video call privately one-on-one or with a group." of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", static text "Have private conversations" of UI element 1 of static text "Have private conversations Sometimes you just want to chat or video call privately one-on-one or with a group." of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", UI element 2 of static text "Have private conversations Sometimes you just want to chat or video call privately one-on-one or with a group." of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", static text "Sometimes you just want to chat or video call privately one-on-one or with a group." of UI element 2 of static text "Have private conversations Sometimes you just want to chat or video call privately one-on-one or with a group." of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 1 of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of button 1 of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", static text "Private chat and calling" of button 1 of list 1 of group 6 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 7 of group 5 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 6 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 1 of group 6 of group 2 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 3 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 4 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", group 5 of group 1 of UI element "Chat | Microsoft Teams" of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 1 of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 2 of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events", button 3 of window "Chat | Microsoft Teams" of application process "Teams" of application "System Events"}¿Qué hace el VoiceOver para acceder a los subelementos de un elemento RenderWidgetHostViewCocoa ? ¿Y se puede hacer desde un propio applescript?
En este momento tengo una automatización simple añadido para activar / desactivar ...
tell application "System Events"
key code 96 using command down
delay 1
key code 96 using command down
delay 1
end tell... pero no es bonito, y VoiceOver se anuncia cada vez :(
