Popis produktu

This book is a comprehensive guide designed to equip engineers, data scientists, and AI practitioners with the principles, tools, and strategies needed to ensure reliability, performance, and accountability in Large Language Models (LLMs). The book begins by laying the groundwork with the foundations of observability, introducing LLMs, their significance in modern AI, and the critical role observability plays in maintaining robust systems. It then explores SRE principles, service level objectives, and incident response, while distinguishing the unique observability challenges that arise in AI and ML systems. Building on this foundation, the book dives into measuring performance, from defining SLOs tailored for LLMs to monitoring computational and token-level metrics. Readers gain practical insights into structured logging, debugging, and distributed tracing methods that provide visibility into complex LLM workflows. Scaling challenges are addressed through strategies for cross-model observability, autoscaling, latency reduction, and fault-tolerant infrastructure design. The book further explores chaos engineering, guiding readers through resilience testing in LLMs and the automation of chaos experiments in CI/CD pipelines. Finally, it highlights monitoring, retraining, and ethical considerations in AI observability, including governance, privacy, and accountability. In conclusion, this book provides a holistic roadmap to building reliable, transparent, and future-ready LLM systems. What you will learn:How to design observability pipelines for LLMs, including token-level logging, prompt tracing, and latency analysis. Techniques for applying chaos engineering principles to test LLM robustness under stress andfailure scenarios. Methods for building SLOs, SLAs, and dashboards tailored to inference quality and modelreliability. Strategies for monitoring hallucinations, drift, bias, and ethical failures in real-time. Who this book is for:This book is for AI infrastructure engineers, SREs, machine learning platform teams, and applied AI practitioners deploying or maintaining LLM-based applications.

Další informace

Observability for Large Language Models - Ankush Sharma

Prodává: Dobrovský
This book is a comprehensive guide designed to equip engineers, data scientists, and AI practitioners with the principles, tools, and strategies needed to ensure reliability, performance, and accountability in Large Language Models (LLMs). The book begins by laying the groundwork with the…
Další informace
1 650 Kč
Skladem
Koupit

Podobné produkty

Informace
Knihy

Like Birds in the Wilderness - Agnes Owens

The building trade in the west of Scotland has slowed, and Mac leaves his home and his companions in the Paxton Arms for the oil-rich north to seek his fortune. But he soon finds himself out in the wilderness, chasing the promise of a job. In the meantime, he’s fallen for Nancy, but he can’t…

297 Kč
Koupit
Systémy něhy - Marek Šindelka Informace
Média

Systémy něhy - Marek Šindelka

Nepodobá se někdy lidský život mechanismu? A kolik něhy se může skrývat ve stroji?  Pianistka Ada Fischerová má před sebou zářnou kariéru, jádro její existence je však vyhaslé. O co vlastně usiluje? Nesnaží se jen zavděčit mrtvému otci? Jeho ztrátou se v ní cosi navždy porouchalo. Jediný dlouhodobý…

359 Kč
Koupit
Narcistické povídky - Blanka Lesana Brázdová Informace
Média

Narcistické povídky - Blanka Lesana Brázdová

Potkáte-li narcistu či narcistku, raději rychle utečte! Může Vás zničit! Autorka při psaní čerpala nejen ze svých osobních zkušeností. V devíti povídkách se věnuje soužití s lidmi s narcistickou poruchou osobnosti, ať už v roli příbuzných, těch nejbližších, tedy rodičů, životních partnerů..., ale…

200 Kč
Koupit
Tomáš Kopa — realitní specialista