The IBM Massive Collection System (MCS) can process billions of data records each day. The system delivers continuous processing with full support for high availability, data recovery, and transaction-based operation. MCS is an enterprise-grade product based on the IBM WebsphereŽ highly scalable Java 2 Enterprise Edition (J2EE) platform.
MCS begins by reading, in real-time and in batch, input records consisting of fields in multiple formats. It then goes on to parse, process and transform the data, enrich the data using lookup tables, detect duplicates and sequence gaps, filter the input, and produce aggregated and non aggregated output records. Next, the system uploads the resulting records to a relational database for easy access and retrieval.
An innovative database loading management system - LOD, reduces database holding space by a large factor to an economically small size which is superior to any other available solution in the market.
Flexibility - A high-level specification module transforms input fields to output fields, based on business-specific rules. These rules can be specified by non-technical staff whose expertise lies in the business domain.
Extendibility - MCS enables the addition of complex functions and extensions specific to customer needs. Using simple Java code elements, customization is made easy for a wide range of application domains.
Ease of use - An EclipseŽ platform plug-in enables users to author new specifications and test them using a graphical editor. This feature offers the continuous validation and real-time consistency alerts available in advanced state-of-the-art interactive development environments (IDE).
Scalability - The system offers full scalability by executing processes in parallel as session Enterprise Java Beans (EJBs). Input is detected through a fully managed process and then undergoes CPU-intensive processing. A follow-up post management process uploads the data to a relational database.
Full support for testing and deployment IBM provides complete support for the specifications modules during development and deployment in the production environment.
MCS is fully integrated within Websphere and is compliant with Tivoli® management.