MarketWide Digital

Owned by Former user (Deleted)
Last updated: Nov 18, 2019 by Alex Burns (Unlicensed)

How The Digital System Works

  • Transaction Service – the MarketWide ‘traffic cop’ interacts with remote clients and dispatches requests on the server.
  • Report Service – accepts queries from the Transaction Service and launches tasks.
  • Tasks –launched by the Report Service as host executables, connect to the marketing database, generate SQL queries.
  • Host Database – results sets from marketing database queries, downloaded to remote clients by the Transaction Service.
  • Email Delivery Engine – sends fully formatted emails to Amazon’s servers, processes bounces and complaints.
  • Digital Feedback – captures email opens and clicks and website activity.
  • System Database – stores all digital data, as well as campaign “work” tables.

Internal Process

  • Email and website activity happen around the clock.

  • Each action, whether a website visit or email open, is captured in real time and written directly into the database; into EA (Email Activity) and WA (Web Activity) tables.

  • MarketWide executes an “aggregator” process every 15 minutes, rolling up EA and WA tables into ER (Email Report) and WR (Web Report) tables.

  • In MarketWide 5.2, upon “commit” Campaign (TouchPoint) data is written into the system database, creating tables having a W_ prefix (Work).

  • In MarketWide 5.3, these tables are created immediately upon submitting a campaign.

Email/Web Rollup Process

Email Aggregator

Web Activity Aggregator

Digital System Architecture

Digital System Architecture


Additional Notes

  • The system captures digital data in real time. As such, the initial activity tables are not made available to the end user. This prevents problems related to table locking and dirty reads.
  • If activity cannot be inserted into the activity tables (e.g. database is offline), activity is redirected to a log file.
  • Log files are automatically imported daily (defaulted to 2am). This create a robust system and prevents any gap in data.
  • MarketWide’s aggregators actively run while new data is being added and reports are running. To prevent process from blocking each other, all real-time processes use “dirty reads” internally.
  • Raw activity data is kept for:
    • 180 days for email
    • 30 days for web data
  • Reporting data is kept indefinitely, except for certain web reporting data which is kept for 365 days due to volume.

MarketWide System Database

Do not access, query, delete or otherwise modify any table in the MarketWide System database.