1.0 Overview
- Client industry: IT
- Objective: To develop a high-concurrency private IP intelligence service that aggregates data from multiple providers to deliver real-time geographical and ownership insights.
2.0 Background
In the dynamic landscape of network administration, IP addresses are frequently reassigned and resold. For organizations relying on IP data for security, routing, or analytics, maintaining accuracy is a significant challenge.
The client required a bespoke, private solution to leverage open-source and free-tier databases (such as IPInfo and MaxMind) while overcoming their standard rate limits. The primary technical requirement was the ability to handle a massive throughput of 10,000+ requests per second (RPS) with negligible latency, supporting both human-readable (HTML) and machine-readable (JSON) outputs.
3.0 Scopes
- Data Aggregation: Integration of MaxMind and IPInfo.io datasets to ensure comprehensive coverage.
- Hybrid API Interface: A dual-format API capable of toggling between JSON and HTML outputs based on request headers or parameters.
- Automated Synchronization: A recurring update mechanism to fetch the latest database definitions daily, ensuring data integrity.
- Granular Access Control: Implementation of a strict IP-whitelisting security model to restrict service access to authorized client ranges only.
4.0 Technical Architecture
To achieve the required performance benchmarks, the system was built using a Microservices Architecture designed for high concurrency.
| Component | Technology | Role |
|---|---|---|
| API Engine | PHP + Swoole | An event-driven, asynchronous coroutine framework to handle high RPS. |
| Data Engine | MaxMind/IPInfo Readers | Optimized binary readers for low-latency lookups. |
| Caching Layer | Redis | In-memory storage to accelerate repeat queries and reduce I/O. |
| Update System | Bash / Cron | Automated scripts for daily database downloads and hot-reloading. |
5.0 Core Features
The solution provides a comprehensive data point for every queried IP:
- Geographic Data: Country, City, Continent, and Timezone.
- Organizational Data: Registered Company Name, Official Website, and Autonomous System Number (ASN).
- Network Metadata: IP Range and Data Source Attribution.
- Accessibility:
- Web Portal: For manual, one-off searches via browser.
- API Endpoint: For seamless integration into existing client workflows via JSON.
6.0 Key Benefits
- Performance at Scale: The asynchronous nature of the Swoole engine allows the system to process 10,000+ requests per second on modest hardware.
- Scalability: The micro-service is lightweight and container-ready, allowing for horizontal scaling as demand grows.
- Data Accuracy: Automated daily updates ensure the client never makes decisions based on stale network data.
7.0 Conclusion
The project was successfully deployed within the established time-frame. By moving from public API dependencies to a self-hosted micro-service, the client achieved higher throughput, improved security via IP-restricted access, and significantly reduced long-term operational costs. The system remains in active use and is maintained for peak performance.
