Empowering people with disabilities using GitHub Copilot

A presentation at axe-con in February 2024 in by Carie Fisher

Slide 1

Slide 1

Empowering people with disabilities using GitHub Copilot

Slide 2

Slide 2

Meet your presenters Carie Fisher Jesse Dugas Ed Summers Senior Accessibility Program Manager Senior Accessibility Program Manager Head of Accessibility at GitHub

Slide 3

Slide 3

What is GitHub Copilot? Code suggestions Style suggestions in real-time Code explanation Understand your code story A virtual tutor Your personal learning coach An ever-growing & learning resource Continuous improvement

Slide 4

Slide 4

Accessibility of the GitHub Copilot interface Screen reader support Keyboard accessibility High contrast themes Zoom and font size adjustments Education and ESL (English as a Second Language) Neurodivergencies

Slide 5

Slide 5

Screen reader demo

Slide 6

Slide 6

Accessibility of the GitHub Copilot interface Screen reader support Keyboard accessibility High contrast themes Zoom and font size adjustments Education and ESL (English as a Second Language) Neurodivergencies

Slide 7

Slide 7

Keyboard demo

Slide 8

Slide 8

Accessibility of the GitHub Copilot interface Screen reader support Keyboard accessibility High contrast themes Zoom and font size adjustments Education and ESL (English as a Second Language) Neurodivergencies

Slide 9

Slide 9

AI pitfalls in accessibility and the need for “humans in the loop” Bias Less data, less accurate results Ethics Appropriate training of the model Hallucinations Be sure to check its work Dependence Enhance productivity, not to rely on

Slide 10

Slide 10

Power of prompting demo

Slide 11

Slide 11

AI pitfalls in accessibility and the need for “humans in the loop” Bias Less data, less accurate results Ethics Appropriate training of the model Hallucinations Be sure to check its work Dependence Enhance productivity, not to rely on

Slide 12

Slide 12

Using GitHub Copilot to improve accessibility Crafting effective prompts Detailed, context and expectations Humans in the loop Validate information and references Strong testing plans Involve real users in testing Continuous improvement Refine prompts and challenge results

Slide 13

Slide 13

gh.io/aiAccessibilityAssistant Using GitHub Copilot to improve accessibility Crafting effective prompts Detailed, context and expectations Humans in the loop Validate information and references Strong testing plans Involve real users in testing Continuous improvement Refine prompts and challenge results

Slide 14

Slide 14

Conclusion GitHub Copilot and GitHub Copilot Chat can empower people to do the work they want to do, responsibly and with increased accessibility. *All content and demos relevant as of March 2024 and are subject to change.

Slide 15

Slide 15

Thank you