Loading Dock

Overview

Large scale operations have constant interaction with externally supplied data that affects or is affected by the current state of the business portfolio. Such data is supplied in the ordinary course of the service provider/user relationship. Often, the data supplied needs to be prepped, held in a staging area, sanitized, or analyzed prior to or after processing it. Sometimes the quantity of data supplied is extremely large.

These circumstances give rise to entire sets of processes and job roles focused specifically on proper handling of routine, often time-critical and sometimes complex data prepping activities necessary to produce business transactions. These activities often require a fair amount of technical skill, and are frequently supported using informally developed solutions with easy to use tools like Microsoft ACCESS or Excel. Business and data processing rules may be informally documented and may be difficult to audit to determine if they were performed correctly. Large scale data transformation and reconciliation operations may involve significant manual effort or processing time. Over time the informal tools developed by a business user are not maintained using a software development lifecycle, and people move on, leaving the tool in a state of uncertainty. These types of solutions are very easy to implement, but have security and other flaws associated with them.


Solutions

The MBMS Loading Dock application helps organizations by providing a controlled environment for managing data staging processes, using the same robust concepts that we use for our system of record application security, usability, auditability, functionality, scalability, configurability, standardization, and extensibility. The Loading Dock performs four functions on data, and does so outside of the portfolio System of Record.

    Function 1 - Acquisition

  • Bulk import of large data sets
  • Auto Generate target data structures from source data
  • Automate and schedule acquisition of recurring feeds
  • Handle data errors in a structured non-fatal manner
  • Configurable processing logic
  • Auto acquire data from an MBMS System of Record
  • Acquire data from Externally supplied files
  • Acquire data from Query of any other trusted database
  • Acquire data from other tables in Loading Dock
  • Acquire data using web services
  • Acquire data from databases on linked servers
    Function 2 - Storage

  • User defined and reusable structures for tables, fields, indexes
  • Standardization of naming conventions
  • Transaction Journals record all schema changes
  • Store data with scheduled expiration date
  • Purge data on scheduled basis
  • Categorize tables
  • Restrict access to user defined tables and related actions
  • Standard user interface and table actions (Delete, Truncate, Export, Rename)



    Function 3 - Search

  • Auto generated parameterized search tool for every user defined table
  • Search large data sets
  • User defined result set views
  • Create and reuse search parameters to generate aggregates and stratifications from result sets
  • Create and reuse ad hoc query extensions to parameterized searches
  • Save search parameters for reuse in 1-click search action from menu
  • Render search results in multiple forms (View, Table, Excel, Report)
    Function 4 - Processing

  • Selection using Search tools
  • Extract data to staging tables
  • Transform data into an files formatted for use in tasks supported by another MBMS System of Record
  • Compare records and data existing in different tables
  • Merge data into a new table from user defined table and mbms system of record data based on matched keys


Use Case Scenarios

    Reconciliation

  • Find Existence Matches and Mismatches
  • Find Data Discrepancies on matched keys
  • Find Duplicates existing within each data source
  • Store discrepancies for research
  • Reconcile data with MBMS System of Record
  • Reconcile data between any two data sets supplied from any two sources
    Service Request

  • Acquire, reformat data
  • Supply sanitized data to System of Record for processing
  • Store source data for audit purposes or reuse in subsequent transactions



    Batch Query

  • Report status on a list of externally submitted keys
  • Preprocess data for inbound data for eligibility against selected transactions
  • Preprocess data to sanitize and test data
    System of Record Snapshot

  • Extract data daily to a user defined table for static position reporting
  • Accumulate measurements of data from System of Record
  • Use collected data to generate trend and other output

About Us

We are a U.S. owned and U.S. based software development and professional services firm. We provide all of our services on-shore from our main office location in Amherst NY.

LinkedIn  Follow us on LinkedIn