Managing gigabytes

About the book

Managing gigabytes is a technical book about making large document collections smaller and easier to search. Ian Witten, Alistair Moffat and Timothy Bell wrote it for people who build systems that hold text, images and other digital material, and who need those systems to work within real limits on disk space, bandwidth and time. The authors begin from a practical observation: the volume of stored information grows faster than the hardware that holds it, so compression and indexing remain live engineering concerns.

The book joins two subjects that are often taught apart. One is data compression: how to represent text, images and other media with fewer bits while preserving what the reader needs. The other is retrieval: how to index a collection so that a query returns relevant documents quickly. The authors argue that these problems interact. A compression scheme changes what an index can assume about the underlying data, and an index design changes which compressed forms are useful. The result is a book about the whole pipeline from raw document to searchable archive.

The scope is broad. It covers coding methods for text and images, standards for coded representation, and techniques for indexing and searching large collections, including material on the web as a document store. The treatment is mathematical where it needs to be, with algorithms stated precisely enough to implement. Readers should expect worked reasoning about codes, probabilities and data structures rather than a survey of products.

How to read it

Approach the book as a course in engineering trade-offs. Each compression method buys space at some cost in computation or fidelity, and each index buys speed at some cost in storage and update effort. Track those costs as you read; they are the argument. The examples and algorithms reward close attention, and the mathematical passages are worth working through with paper rather than skimming.

The prose is clear but dense, and the book's age matters. The principles of coding and indexing hold up well, while specific standards, hardware assumptions and web references reflect their moment. Read the conceptual chapters for durable ideas and treat concrete format details as historical context. A reader new to the field may want a modern compression or information retrieval text alongside it for current practice.

Who it suits

This suits software engineers, graduate students and researchers who need to understand how compression and indexing fit together in document systems. It also serves readers who want the algorithmic foundations behind search and storage tools rather than a product guide. Anyone comfortable with basic probability and data structures will find the reasoning accessible; readers seeking a gentle introduction or current tooling advice should look elsewhere first.

Reading considerations

The book is an older textbook, so its treatment of standards, hardware and the web is dated, and later editions or newer texts may cover current formats and practice. Check which edition you have before relying on specific details. The mathematical density also means it is not a quick reference; readers wanting implementation recipes should test whether the level of formalism matches their needs.