Block Trace Analysis and Storage System Optimization (eBook)
XVII, 271 Seiten
Apress (Verlag)
978-1-4842-3928-5 (ISBN)
In the new era of IoT, big data, and cloud systems, better performance and higher density of storage systems has become crucial. To increase data storage density, new techniques have evolved and hybrid and parallel access techniques-together with specially designed IO scheduling and data migration algorithms-are being deployed to develop high-performance data storage solutions. Among the various storage system performance analysis techniques, IO event trace analysis (block-level trace analysis particularly) is one of the most common approaches for system optimization and design. However, the task of completing a systematic survey is challenging and very few works on this topic exist.
Block Trace Analysis and Storage System Optimization brings together theoretical analysis (such as IO qualitative properties and quantitative metrics) and practical tools (such as trace parsing, analysis, and results reporting perspectives). The book provides content on block-level trace analysis techniques, and includes case studies to illustrate how these techniques and tools can be applied in real applications (such as SSHD, RAID, Hadoop, and Ceph systems).
What You'll Learn
- Understand the fundamental factors of data storage system performance
- Master an essential analytical skill using block trace via various applications
- Distinguish how the IO pattern differs in the block level from the file level
- Know how the sequential HDFS request becomes 'fragmented' in final storage devices
- Perform trace analysis tasks with a tool based on the MATLAB and Python platforms
Who This Book Is For
IT professionals interested in storage system performance optimization: network administrators, data storage managers, data storage engineers, storage network engineers, systems engineers
Jun Xu got his B.S. in Mathematics and Ph.D. in Control from Southeast University (China) and Nanyang Technological University (Singapore), respectively. He is a Lead Consultant Specialist in Hongkong-Shanghai Banking Corporation (HSBC) and was a Principal Engineer in Western Digital. Before that, he was with Data Storage Institute, Nanyang Technological University, and National University of Singapore for research and development. He has multi-discipline knowledge and solid experiences in complex system modeling and simulation, data analytics, data center, cloud storage, and IoT. He has published over 50 international papers and 15 US patents (applications) and 1 monograph. He is an editor of the journal Unmanned Systems and was a committee member of several international conferences. He is a senior member of IEEE and a certificated FRM.
Understand the fundamental factors of data storage system performance and master an essential analytical skill using block trace via applications such as MATLAB and Python tools. You will increase your productivity and learn the best techniques for doing specific tasks (such as analyzing the IO pattern in a quantitative way, identifying the storage system bottleneck, and designing the cache policy).In the new era of IoT, big data, and cloud systems, better performance and higher density of storage systems has become crucial. To increase data storage density, new techniques have evolved and hybrid and parallel access techniques-together with specially designed IO scheduling and data migration algorithms-are being deployed to develop high-performance data storage solutions. Among the various storage system performance analysis techniques, IO event trace analysis (block-level trace analysis particularly) is one of the most common approaches for system optimization and design. However, the task of completing a systematic survey is challenging and very few works on this topic exist.Block Trace Analysis and Storage System Optimization brings together theoretical analysis (such as IO qualitative properties and quantitative metrics) and practical tools (such as trace parsing, analysis, and results reporting perspectives). The book provides content on block-level trace analysis techniques, and includes case studies to illustrate how these techniques and tools can be applied in real applications (such as SSHD, RAID, Hadoop, and Ceph systems).What You'll LearnUnderstand the fundamental factors of data storage system performanceMaster an essential analytical skill using block trace via various applicationsDistinguish how the IO pattern differs in the block level from the file levelKnow how the sequential HDFS request becomes "e;fragmented"e; in final storage devicesPerform trace analysis tasks with a tool based on the MATLAB and Python platformsWho This Book Is ForIT professionals interested in storage system performance optimization: network administrators, data storage managers, data storage engineers, storage network engineers, systems engineers
Jun Xu got his B.S. in Mathematics and Ph.D. in Control from Southeast University (China) and Nanyang Technological University (Singapore), respectively. He is a Lead Consultant Specialist in Hongkong-Shanghai Banking Corporation (HSBC) and was a Principal Engineer in Western Digital. Before that, he was with Data Storage Institute, Nanyang Technological University, and National University of Singapore for research and development. He has multi-discipline knowledge and solid experiences in complex system modeling and simulation, data analytics, data center, cloud storage, and IoT. He has published over 50 international papers and 15 US patents (applications) and 1 monograph. He is an editor of the journal Unmanned Systems and was a committee member of several international conferences. He is a senior member of IEEE and a certificated FRM.
Erscheint lt. Verlag | 16.11.2018 |
---|---|
Zusatzinfo | XVII, 271 p. 91 illus. |
Verlagsort | Berkeley |
Sprache | englisch |
Themenwelt | Mathematik / Informatik ► Informatik ► Netzwerke |
Informatik ► Weitere Themen ► Hardware | |
Schlagworte | Benchmarking • Big Data • Block trace • Ceph • Enterprise • Hadoop • Hybrid storage • MATLAB • Non-volatile Memory • Python • RAID • Storage design • storage systems • Trace analysis |
ISBN-10 | 1-4842-3928-8 / 1484239288 |
ISBN-13 | 978-1-4842-3928-5 / 9781484239285 |
Haben Sie eine Frage zum Produkt? |
![PDF](/img/icon_pdf_big.jpg)
Größe: 9,9 MB
DRM: Digitales Wasserzeichen
Dieses eBook enthält ein digitales Wasserzeichen und ist damit für Sie personalisiert. Bei einer missbräuchlichen Weitergabe des eBooks an Dritte ist eine Rückverfolgung an die Quelle möglich.
Dateiformat: PDF (Portable Document Format)
Mit einem festen Seitenlayout eignet sich die PDF besonders für Fachbücher mit Spalten, Tabellen und Abbildungen. Eine PDF kann auf fast allen Geräten angezeigt werden, ist aber für kleine Displays (Smartphone, eReader) nur eingeschränkt geeignet.
Systemvoraussetzungen:
PC/Mac: Mit einem PC oder Mac können Sie dieses eBook lesen. Sie benötigen dafür einen PDF-Viewer - z.B. den Adobe Reader oder Adobe Digital Editions.
eReader: Dieses eBook kann mit (fast) allen eBook-Readern gelesen werden. Mit dem amazon-Kindle ist es aber nicht kompatibel.
Smartphone/Tablet: Egal ob Apple oder Android, dieses eBook können Sie lesen. Sie benötigen dafür einen PDF-Viewer - z.B. die kostenlose Adobe Digital Editions-App.
Buying eBooks from abroad
For tax law reasons we can sell eBooks just within Germany and Switzerland. Regrettably we cannot fulfill eBook-orders from other countries.
aus dem Bereich