Check out Distributed Systems Pattern: Segmented Log by . Here is an excerpt:
A single log file can grow and become a performance bottleneck while
its read at the startup. Older logs are cleaned up periodically and doing
cleanup operations on a single huge file is difficult to implement. A
Segmented Log splits the logfile into smaller files.