The Architecture Behind Telecom Billing: What Makes Systems Scale?

[aliceejane]

Following up on the peak traffic discussion, I want to look at the underlying architecture question: what makes a telecom billing system scale under pressure? This is partly a software engineering question, but it's also a question about how billing systems are designed at a fundamental level.

Batch vs Event-Driven Architecture​

Traditional billing systems are batch-oriented: CDRs accumulate in a queue and are processed in scheduled runs. This works well at low volumes and is simple to implement. Under peak traffic, the batch queue grows faster than it can be processed leading to the delays and accuracy issues discussed in the earlier thread.

Event-driven architectures process each CDR as a discrete event the moment it arrives. This approach scales horizontally you can add processing capacity without redesigning the pipeline. The trade-off is complexity: event-driven systems are harder to debug and require more sophisticated error handling.

Database Design Under Load​

The database is almost always the bottleneck in billing systems under load. Rating a CDR requires looking up the customer record, the applicable rate table, and potentially the current session state all under concurrent load. Systems that can separate the high-read rating path from the high-write CDR ingestion path tend to handle peaks far better.

Horizontal vs Vertical Scaling​

Vertical scaling (bigger servers) has a ceiling. Horizontal scaling (more instances) is theoretically unbounded but requires the billing application to be stateless — or to share state efficiently. Rating engines that hold rate tables in memory handle this well; those that query the database for every record do not.

The Practical Implication​

When evaluating billing platforms, ask vendors directly about their architecture under load. Ask for benchmarks at 3x and 10x normal volume. The difference between a well-architected and poorly-architected system becomes starkly visible under peak conditions.

Closing / Discussion Prompt​

Has anyone run formal load testing on their billing platform? Curious what the failure modes looked like and how they were addressed.