evaluative studies
The following is a
summary of independent studies into the validity of the Morrisby Report.
Level
of Use
'The Morrisby Report is the most popular test battery based
guidance product with UK careers services and careers companies. The Morrisby
Organisation has links with over 70% of such services and has held this position
since the early 1990's' (DfEE 1996) [Department for Education and Employment]
In addition the Morrisby Report is the tool used by the Independent
Schools Careers Organisation in the UK, who provide guidance in 70% of private
schools.
Careers Guidance Surveys
The Morrisby Report, which is the combination of the Morrisby
Profile and the Morrisby Vocational Questionnaire, has been the
subject of at least 10 independent surveys. These have involved both students
and adults clients with data being gathered through face-to-face interviews and
user questionnaires. In many cases all the relevant stake-holders (test takers,
teachers, advisers and parents) have commented on the testing and feedback
process.
A summary of who delivered the tests, the nature of the sample and the numbers involved is provided below:
| Careers Service |
Age of sample
| No. of clients |
Kent (1993) |
16-17 |
116 |
| Wiltshire (1995) |
15-16 (under achievers) |
37 |
| Cornwall & Devon (1995) |
15-16 |
190 |
| Cambridgeshire (1995) |
Adults |
97 |
| Oldham (1995) |
15-16 |
236 |
| Black Country (1996) |
15-16 |
53 |
| East Lancashire / DfEE (1996) |
15-17 |
360 |
| Hertfordshire (1996) |
15-16 |
125 |
| Somerset (1996) |
16-17 |
188 |
| Staffordshire (1996) |
15-16 |
253 |
|
Total
|
1655
|
The information from these surveys provides a good indication of how the
Morrisby Report is received and the effects, both perceived and behavioural, it has on careers
service clients. The East Lancashire survey, in particular, which formed the
basis of the first research briefing from the DfEE's Quality Assurance and
Development Unit (QADU), provides valuable insights into the added value of
testing over the careers interview alone.
A cross sectional analysis of these surveys suggests that the
Morrisby Report adds significantly to the primary objectives of any careers guidance
service, namely that it helps people to plan the career and educational
path for which they appear to be best suited; maximises the efficiency
with which careers advisers can use the time at their disposal, while
helping to promote a positive and professional image.
When the data is examined at a deeper level, four key themes emerge:
Morrisby
Report presents results that are seem as informative,
positive and realistic
These points are made strongly in the QADU report and reinforced by the
Devon, Kent and Staffordshire surveys. For example over 75% of the pupils
interviewed in Kent agreed that the information provided was clear and easy to
understand. A significant number thought that the entire report was accurate
(61%), with any discrepancies usually being cleared up after a further
discussion and explanation.
Most felt that they had learnt something new from the report (55%) and
two-thirds reported that they had been surprised by some of the results. These
'surprise' results were frequently perceived in a positive light and attributed
to aptitudes or personal characteristics, which hadn't been recognised or
valued. In the Devon survey over 70% agreed with most of what the report said
about the abilities, and in the Staffordshire virtually all pupils were in
agreement with the sections describing their abilities and personality.
Other interested parties, in particular parents, were impressed by the
reports. In Staffordshire 85% were happy with the information provided and
described the reports as "very positive", "comprehensive",
"interesting and professionally presented".
Self-awareness is enhanced through the use of well designed
reports
The QADU report highlighted the 'added value' of psychometric assessment in
terms of increased self-awareness, aspirations and identification of
occupational opportunities over the careers interview alone. An impressive 97%
of clients reported that personal strengths had been identified - over a quarter
more than with a careers interview. 21% of clients reported considering higher
level course options, whether vocational or academic, more than half more than
with an interview alone. In terms of career areas 54% said that they had been
able to identify more areas worth exploring than with the interview alone (24%).
Overall 92% said that their choice of career options had been influenced, most
in the direction of considering a wider range of options.
Similar sorts of findings flow from the Devon, Somerset and Wiltshire
surveys. In Somerset 91% of pupils reported that they had a better idea of what
the would do after leaving school as a consequence of taking the tests, indeed
94% also said that it had made them feel more confident about the future. The
majority of parents (75%) and all of the careers advisers considered the
Morrisby Report to
be helpful in decision-making. In Wiltshire the 'Raising Achievement' project
again illustrates that the Morrisby Report produces positive shifts in awareness of
abilities, particularly in those areas not explicitly measured by school
assessments.
Aptitude and career or educational mismatches are
identified
The Wiltshire survey demonstrated that the Morrisby Report has an important role to play
in helping underachievers by increasing awareness and contrasting test results
with school performance. Better choices can then be made as pupils can match a
range of 'non-school' abilities, such as perceptual, spatial and mechanical
reasoning, with available opportunities. A point also made in the Black County
report. Adults, such as those who took part in the Cambridgeshire survey, also
reported that the process clarified thoughts, and to quote one client.
"..this report has taken away some of the misconceptions I had about my
abilities."
The QADU report bears out the fact that the effects of psychometric
assessment are more marked for the vocationally undecided; many of whom are
likely to end upon the 'wrong' course or the 'wrong' career. As such the
increases in self-awareness, and the identification of suitable career options
facilitated by the Morrisby Report process, can be seen to positively act against the
potential dangers of educational or occupational mismatches.
Finally it is fair to say that much of the data in this area is by necessity
anecdotal. However there are many instances of clients changing their options
away from those which did not match their profile and towards careers which were
more in tune with their pattern of abilities and personality, with positive
results.
Effects of psychological barriers are minimised
Gender or social stereotyping, perceived academic under-achievement and lack
of self-confidence and motivation, influences many clients. The Morrisby Report provides
objective and unbiased information and helps to remove such barriers to
progress. This is evidenced by many of the surveys, for example those conducted
in Cambridgeshire and Wiltshire. As has been mentioned confidence, aspiration
and motivation levels are typically raised significantly as a result of the
Morrisby Report process. Stereotyping is also counteracted as job suggestions are based on test and
interest questionnaire results.
|
