The Tech > Emerging tech > Artificial Intelligence > AI Auditing - (20)

Projects, resources, and groups that audit public, democratic, or civic AI to ensure equitable and ethical outputs.

Recommended resources:

  • The Adversarial Algorithmic Auditing Guide by Eticas "focuses on adversarial or third-party algorithmic audits, where independent auditors or communities thoroughly examine the functioning and impact of an algorithmic system, when access to the system is restricted."

Showing 20 Results

Humane Intelligence

Humane Intelligence

United States of America (the)

Humane Intelligence is a tech nonprofit building a community of practice around algorithmic evaluations.

Auditing TikTok. Social media’s treatment of migrants

What is the impact of social media on the representation and voice of migrants and refugees in Europe? What are the challenges and opportunities to avoid their invisibilization and promote a fair representation?

Algorithmic audit of Laura Robot

Since 2016, the Laura Robot has analyzed more than 8.6 million visits in 40 clinical and hospital centers in several Brazilian states.

Eticas conducts an external and independent audit of the VioGen system

In Spain, the level of risk to which a victim of gender violence is subjected is determined by an algorithm. The system to which it belongs is VioGén which, with more than 3 million risk evaluations, is the risk assessment system with the most registered cases in the world.

Algorithmic audit of Koa Health

The success of Koa Health and Eticas serves as a beacon for the broader industry, emphasizing the importance of ethical considerations when developing mental health solutions.

Deep learning for social services for the Barcelona City Council

With the collaboration of Universidad Pompeu Fabra (Barcelona), Eticas carried out an audit of the natural language processing (NLP) system from the Social Services area from the Barcelona City Council.

Auditing YouTube. Social media’s treatment of migrants

What is the impact of social media on the representation and voice of migrants and refugees in Europe? What are the challenges and opportunities to avoid their invisibilization and promote a fair representation?

Tracking Local Law 144 bias audits

ACLU's crowd-sourced public tracker of bias audits of automated employment decision tools (AEDTs) released by employers related to NYC's Local Law 144.

AIForensics

AIForensics

Italy (Italia)

AI Forensics is a European non-profit that investigates influential and opaque algorithms.

Eticas Foundation

Eticas Foundation

New York, NY

Community-led AI Audits: Making AI Systems Fair & Accountable

The Observatory of Algorithms with Social Impact (OASI)

The OASI Register compiles information about algorithms with the aim of increasing public awareness and providing the necessary knowledge for an informed public conversation, and of making possible for experts and the public to search and analyse the use and social impact of algorithmic systems across the world.

ForHumanity

ForHumanity

New York, USA

To examine and analyze the downside risks associated with the ubiquitous advance of AI & Automation, to engage in risk mitigation and ensure the optimal outcome… ForHumanity.

Automating (In)Justice: An Adversarial Audit of RisCanvi

Eticas Foundation's adversarial audit of an AI-powered criminal justice tool, RisCanvi, that has been used in Catalonia since 2009 finds it "does not meet the required standards of reliability and fairness."

MLCommons AI Safety

The MLCommons AI Safety working group is composed of a global consortium of industry leaders, practitioners, researchers, and civil society experts committed to building a harmonized approach to AI safety.

International Algorithmic Auditors Association (IAAA)

The IAAA is a community of practice that aims to advance and organize the algorithmic auditing profession, promote AI auditing standards, certify best practices and contribute to the emergence of Responsible AI.

Eticas

We now bring this decade’s worth of insights and our intellectual capital to scale with our automated audits, and proprietary demographic and geographic database used to ensure the validity (and compliance) of the outputs.

Eticas Consulting

Eticas teams up with organizations to identify black box algorithmic vulnerabilities and retrains AI-powered technology with better source data and content.

Back to Top