Multimodal Artificial Intelligence and Large Language Models: A Comprehensive Guide from Theory to Practice
暫譯: 多模態人工智慧與大型語言模型：從理論到實踐的全面指南

本書提供了多模態人工智慧系統及其實作框架的全面技術分析。它詳細涵蓋了可用的跨模態處理方法，包括語音識別和自動圖像標題生成。

- 本書詳細討論了整合文本、圖像、音頻和視頻模態的架構、跨模態處理管道及數據融合技術。
- 展示了不同模態之間的實時同步機制以及多模態系統的可擴展設計模式。
- 討論了使用深度學習技術的多模態情感識別，重點關注最近的進展、挑戰和倫理考量。
- 探討了部署優化策略，以解決多模態系統的延遲、資源使用和可擴展性問題。
- 專注於使用如 PyTorch 和 TensorFlow 等框架的多模態工作負載的性能優化、內存管理和分佈式處理技術。

本書主要針對電機工程、電子與通信工程、計算機科學與工程以及資訊科技的高年級本科生、研究生和學術研究人員撰寫。

L. Ashok Kumar is Principal at Thiagarajar College of Engineering, Madurai, Tamil Nadu, India. He was a Postdoctoral Research Fellow from San Diego State University, California. He has three years of industrial experience and twenty-three years of academic and research experience. He has published 173 technical papers in International and National journals and presented 167 papers in National and International Conferences. He has developed 27 products, and out of those, 23 products have been technology transferred to industries and for Government funding agencies. His areas of interest include wearable electronics, renewable energy systems, power electronics and drives, and smart grids.

D. Karthika Renuka is a Professor in the Department of Information Technology at PSG College of Technology, India. Her professional career of 20 years has been with PSG College of Technology since 2003. She is an Associate Dean (Students Welfare) and a convenor for the Students' Welfare Committee at PSG College of Technology. She was a Postdoctoral Research Fellow from Wright State University, Ohio, USA. Her area of specialization includes data mining, evolutionary algorithms, soft computing, machine learning, deep learning, affective computing, and computer vision. She has published papers in reputable National and International journals and conferences.

Tanvi Banerjee is an Associate Professor in the Department of Computer Science and Engineering at Wright State University, USA, and has a secondary appointment at the Department of Geriatrics at the Boonshoft School of Medicine, Wright State University, USA. Her academic focus has been at the crossroads of artificial intelligence and healthcare, revolving around multimodal data fusion, wearable sensing, and mobile healthcare technologies. She has been a recipient of the prestigious K01 grant awarded by NIH (equivalent to the CAREER pathway in NSF) for the project on Dementia Management using smartphone technologies and a co-investigator in the NIH R01-funded Sickle Cell Disease project.

Deisy Chelliah is currently a Professor and the Head of the Information Technology Department at Thiagarajar College of Engineering in Madurai, Tamil Nadu, India. She has twenty-four years of teaching experience. Her areas of interest include machine learning, artificial intelligence, natural language processing, and data mining. She has published more than 90 research articles in journals and conferences.

L. Ashok Kumar 是印度泰米爾納德邦馬杜賴的 Thiagarajar 工程學院的院長。他曾是加州聖地牙哥州立大學的博士後研究員。他擁有三年的產業經驗和二十三年的學術及研究經驗。他在國際和國內期刊上發表了173篇技術論文，並在國內和國際會議上發表了167篇論文。他開發了27個產品，其中23個產品已轉移至產業及政府資助機構。他的研究興趣包括可穿戴電子產品、可再生能源系統、電力電子與驅動技術，以及智慧電網。

D. Karthika Renuka 是印度 PSG 工程技術學院資訊科技系的教授。自2003年以來，她在 PSG 工程技術學院的專業生涯已有20年。她擔任學生福利副院長及學生福利委員會的召集人。她曾是美國俄亥俄州 Wright State University 的博士後研究員。她的專業領域包括資料探勘、演化演算法、軟計算、機器學習、深度學習、情感計算和計算機視覺。她在知名的國內和國際期刊及會議上發表了多篇論文。

Tanvi Banerjee 是美國 Wright State University 計算機科學與工程系的副教授，並在 Wright State University 的 Boonshoft 醫學院老年醫學系擔任副職。她的學術重點位於人工智慧與醫療保健的交匯處，圍繞多模態數據融合、可穿戴感測技術和移動醫療技術。她曾獲得美國國立衛生研究院（NIH）頒發的 K01 獎助金（相當於國家科學基金會的 CAREER 路徑），該項目專注於使用智能手機技術進行癡呆症管理，並且是 NIH R01 資助的鐮刀型細胞病項目的共同研究者。

Deisy Chelliah 目前是印度泰米爾納德邦馬杜賴的 Thiagarajar 工程學院資訊科技系的教授及系主任。她擁有二十四年的教學經驗。她的研究興趣包括機器學習、人工智慧、自然語言處理和資料探勘。她在期刊和會議上發表了超過90篇研究文章。