The two extracts from Turas People and SWISS are merged each month within NES' Workforce Data Warehouse.
The first part of this process is to apply a series of checks to the Turas People data. Records or values which fail to meet certain criteria are identified and removed. For example, records with a missing board of placement are removed, and any record which has a staff age of less than 20 or greater than 75 is removed. Further checks are then carried out to identify any system-level data issues. For example, counts of missing or duplicate values in certain fields.
The next part of this process is to merge the Turas People data with SWISS. There is no complete, unique identifier in across these data. The data are therefore joined based on combinations of fields.
We cannot merge approximately 150 (2%) of records in Turas People with SWISS because they fail all attempted matches. There are several reasons why this might happen, for example, missing data, data entry errors in either data set (different spellings of names), or the systems may be updated at different times.
The output of the checking and matching are reviewed by a data analyst.
For records that are matched, data taken from Turas People include Date of Birth, Sex, Registration Body, Specialty, Medical Grade, Group Code, Main Cost Centre, Employer Code, Base Location, Start Date.
For doctors in training, it is their current post specialty that is used. This means that doctors who are on Foundation training programmes or general training programmes which involve rotations into different specialties, e.g. General Practice, they are counted in the specialty that they are currently working in, which is not necessarily the same as the programme specialty.
Records in Turas People that remain unmatched are discarded since we assume that people employed in NHSScotland will be in SWISS as this is linked to payroll. If we include unmatched Turas People records, then we risk double-counting people.
Medical DiT records in SWISS that remain unmatched are used, but may report the wrong board of placement or specialty.