Task

Imagine you are a software designer. A client has approached you requesting a Critical App Assessment that will enable their company to ensure the app is socially, ethically, legally, psychologically and in other ways responsible and thoughtful. They have sent you the following memo outlining the job they are hiring you to do:

Algo Rhythm, Inc Logo and Letterhead with the following contact information

Phone: 305-348-2000
Email: barbfinke@algorythm.com
Location: 123 Rhythm Nations St, Any City, ST 12345

Date: January 13, 2022

From: Barbra Finklestein, Head of Research & Development, Algo Rhythm

To: Design Team Members, [Your Company Name]

Subject: Statement of Work for Critical App Assessment

This document lays out the scope of work for the upcoming agreed upon contract to be executed by [Your Company Name] (engineer) on behalf of Algo Rhythm, Inc. (client).

Algo Rhythm is a venture capital and app development company with a portfolio focused on information technology and mobile apps that help society. We have are looking to assess the efficacy, societal, ethical, and equity impacts of one of our existing apps. We would like the project team to design and conduct user experience testing that assesses the product and make recommendations for improvements.

We suggest that you select an app or web-service that you are able to acquire for cheap or free to conduct your testing. We suggest the following example categories:

Search apps – This includes sites that help you search for travel, lodging, products, purchases, and other information. For a search app, you can test a series of search terms and document the outputs. Look for bias and outputs that do not benefit society.
Free accounts with user data – This includes most social media apps. Examine the terms of service and profit model to understand how user data is utilized for profit. Create one or more free new account(s) to test the way the algorithm (or other process) works. Document your inputs and outputs to look for features that do not benefit society.
Innovative feature or tool apps – This includes new advertised features on a new model and other apps that purport to revolutionize or innovate a societal need. This could include new uses for facial recognition, or apps that will use machine learning to adapt and improve. For a new feature app, you can consider what extreme user tests may test the limits of the app and document findings.

We request that [Your Company Name] prepare a Critical App Analysis Report including:

Overview. An overview of the app, its history and purpose, its general use. Discuss the positive aspects of the app. When the app was introduced or when it continues to be discussed, what is the hope for it?
Critique. A critique of the app from societal, ethical, legal, psychological, and other perspectives. Make your own critiques using readings from class, and also find and cite critiques published by others. Are there clear consequences for different groups in society? Are there more subtle or potential ramifications? Are there possible negative extremes the app could bring about? Are there some users excluded from benefits the app provides?
Test design. A test design to examine a key aspect of the app that you predict is a problem. Explain the procedures, test conditions, and iterations of tests you used to come up with your evidence.
[This step could be omitted by faculty whose students are perhaps not trained or studying statistical methods.] Test results. Be sure to include some statistical representations across multiple test conditions. These could be descriptive statistics (mean, median, mode, standard deviation) or a simple statistical test (t-test).
Conclusions and Recommendations. Analyze the test results and draw conclusions about the relative value and harm the app provides to society. Make three practical suggestions for changes that would increase the app’s value (these suggestions could include suggesting non-app solutions instead).

We can provide further documentation and answer any questions upon request.

Please provide a Critical App Assessment Report by [Due Date] with your recommendations for our company. The budget allocated for this project has been agreed separately.

Kind Regards,

Barbra Finklestein

Head of Research & Development

Algo Rhythm, Inc