AI Governance Comprehensive: Tools, Vendors, Controls & Regulations.' is coming out in...
Ash Srivastava - July 21, 2024
📚 "AI Governance Comprehensive: Tools, Vendors, Controls & Regulations." is coming out in September.
This extensive guide covers 90 vendors and 90 controls, with mappings to the EU AI Act. At 362 pages, it's packed with valuable insights and will be available as a free download in September. Each week, Sunil Soares will be sharing snippets from his upcoming book.
One fascinating area covered is AI Observability. Given the EU AI Act’s emphasis on post-market monitoring of high-risk AI systems, this is incredibly timely.
In the example shared, they reviewed the trace for one record from a dataset in Arize. The trace includes "span" types like query, synthesize, LLM, retrieve, and embedding. It showed a latency of 3.63 seconds, with 3.06 seconds for synthesize/LLM and 0.57 seconds for retrieve. The LLM used 372 tokens. Evaluations for Hallucination and QA_Correctness were marked as "hallucinated" and "incorrect," highlighting the importance of these checks.
Can't wait to read more and dive into the full book in September!
First shared on LinkedIn.