#PAGE_PARAMS# #ADS_HEAD_SCRIPTS# #MICRODATA#

A case study of the use of verbal reports for talent identification purposes in soccer: A Messi affair!


Authors: Matthew J. Reeves aff001;  Allistair P. McRobert aff002;  Colin J. Lewis aff003;  Simon J. Roberts aff003
Authors place of work: School of Sport & Health Sciences, University of Central Lancashire, Preston, Lancashire, United Kingdom aff001;  The Football Exchange, School of Sport & Exercise Sciences, Liverpool John Moores University, Liverpool, United Kingdom aff002;  School of Sport & Exercise Sciences, Liverpool John Moores University, Liverpool, United Kingdom aff003
Published in the journal: PLoS ONE 14(11)
Category: Research Article
doi: https://doi.org/10.1371/journal.pone.0225033

Summary

Using a two-study approach, the main purpose of this case study was to explore the use of a verbal reporting methodology to better understand the thought processes of soccer talent scouts during an in-situ talent identification environment. Study 1 developed a standardized coding-scheme to examine verbal cognitions during a single soccer game. Study 2 then utilized this methodology to examine two full-time recruitment staff trained in the use of concurrent verbal reporting before undertaking a live, in-game task. Participants also participated in a debrief interview following the game. The findings of the two studies suggest that developing a verbal reporting protocol is viable, however when applied in a live-game environment it is problematic. Future research should therefore consider a modified version of this task to further explore the cognitions of scouts whilst observing and identifying potential talent.

Keywords:

Qualitative studies – Cognition – Eyes – Sports – Games – Decision making – Intelligence – Human performance

Introduction

In professional sports such as soccer, heads of player recruitment and coaches are constantly striving for the most effective methods of identifying and developing potentially talented youth players [1]. Given the performance advantage a professional soccer organisation can gain over other teams by ‘scouting’ the most talented young players and coupled with the considerable financial rewards potentially on offer, the value of an effective scouting system is evident [2]. From a business perspective, individual players become a valuable human resource [3], which in turn, places considerable importance on the network of talent scouts and recruitment staff who perform the role of identifying and recruiting talented youth players into professional academies. A recent systematic review [4] of talent identification and development in male football identified four broad areas of research interest: 1) task constraints; 2) performer constraints; 3) environmental constraints; and 4) multidimensional analysis. This review, however, identified that there is a larger predisposition for studying developmental aspects of performance, as opposed to identification processes; possibly due to the inherent difficulties associated with identification, especially at younger ages [5]. This is, perhaps, further compounded by the lack of a consensus that defines talent [6, 7, 8].

Researchers interested in talent identification in junior-elite soccer have grappled for many years to develop adequate and objective assessments of talent identification processes in naturalistic and laboratory-based settings [9]. This study, therefore, acts a pragmatic, first step in considering whether a naturalistic approach is feasible and/or appropriate for talent identification purposes. We adopted an exploratory case study design and suggest that results should be treated with appropriate caution given the design utilised.

Applied talent identification process

Despite the reported methodological constraints synonymous with talent identification research (see [9] for a full review), and as others have already testified [10], identification and selection is a necessary process on a long and winding road to elite performance [11]. Talent scouts act as the on-the-ground face of the clubs that they represent; they are the individuals who often make first contact with potentially talented players. Whilst their primary function is to identify players and pass on information to full-time recruitment staff, they regularly continue to communicate with players and their family during and after a trial period with the club may have taken place [12]. Talent scouts, therefore, play an important role in the decision-making process regarding the players that are recruited to a club; they observe, capture data, and employ subjective judgements based on on-field actions [13].

Despite advancements in technology and the innovation of new multimedia platforms, the ability for academies to collect, collate, and manage data on grassroots junior soccer players is restricted. In most instances, academies collate a range of opinion-based qualitative and quantitative data on individual players that is loosely positioned around the clubs’ recruitment and playing philosophy [14, 15]. Observations are usually, but not always, repeated a number of times before a decision is made about whether or not to recruit a player [12, 14, 15]. Evidence from England, however, suggest that academies are not good at determining or, more precisely, explaining what attributes they are observing when they are trying to identify talented youngsters [14, 15]; a suggestion that is echoed in talent identification and development work elsewhere [5, 16].

Those who undertake scouting roles are, typically, individuals who have spent some considerable time either playing or coaching soccer [15]. However, unlike coaches, talent scouts are not required to possess any formal qualification to undertake the work that they do [17]. The Premier League [17] outlines their recommended qualifications for a range of staff, including coaching and medical, though there is variation between clubs as to how this is operationalised [14]. Coaches working in an academy environment require a range of qualifications. Formal soccer qualifications require coaches to have achieved a defined level of competency in theoretical and practical tasks, and assessments are specific to technical, tactical, strategic, organisational, physiological, and psychological determinants of soccer coaching [18].

This education and training divide between the two groups (i.e. scouts and coaches) is not easily explained especially if one considers the fast-paced, dynamic, and multidimensional nature of soccer. Combined with the speed of player movements, the number of players involved and the subjective nature of visual observations [10, 19], it becomes even less obvious why identification procedures have not received further empirical ecological attention [20]. This ambivalence may be explained by the equivocality surrounding notions of what talent [identification] means [in sport] [11] and the confusion and contradictory language which permeates its way through and across the talent development literature (see [21] for a review of psychological terms). Approaching two decades from the publication of the Williams and Reilly [22] model of talent predictors in soccer, talent identification and selection processes continues to rely on apparent subjective (mis)judgements of talent scouts and recruitment personnel.

As noted earlier, little is known about “what” talent scouts do, or more importantly “think” when identifying and selecting players in either development, or performance domains, during both competition and/or practice in real time. Previous soccer talent identification studies using qualitative interview techniques have argued “that coaches regard a player’s speed, play intelligence and attitude toward training and learning the game as criteria they look for when identifying talent” [23]. Whereas others have suggested that the most talented youth soccer players (i.e. 15–16 years) possess speed, ball control, and an overall desire to succeed [24].

This rather obtuse position is in contrast to a body of well-established research surrounding talent development where the influence of the environment in developing the player is considered vital [25]. In support of this Mills and colleagues [26] reported how ten expert development coaches considered discrete psychological factors such as awareness, resilience, goal directed attributes, intelligence, sport-specific attributes, and the environment as fundamental if players were to progress to the professional level. To date, however, there has been little interest in recruitment staff as a participant group for talent identification research, many previous studies have, as already mentioned, tended to utilise coaches [27, 28] despite coaches, arguably, having greater responsibility for player development than identification [12, 14]. Those studies that have included recruitment staff as participants have, so far, used semi-structured interview techniques to elicit the factors affecting the talent identification process from a structural, organisational [12, 14] and philosophical perspective [29].

A potentially useful methodology for addressing this current gap in the talent literature is verbal reports [30]. Since its development by Ericson and Simon [31] (see [32] the use of verbal reports as a technique to elicit the verbalisation of thoughts while performing a task has been widely deployed amongst skilled athletes in exercise settings [33]. Grounded in positivist and empiricist epistemological assumptions, these studies have typically included the use of closed skills from individual sports. For example, in their study of adolescent high-performance golfers, Nicholls and Polman [34] sought to understand acute stress and coping during golf putting performance. Their study demonstrated the appropriateness of concurrent verbal reporting protocols during skill performance to understand how athletes dealt with stress and developed strategies for coping during performance. More recently, Samson et al. [35] adopted concurrent verbal reporting for use with distance runners. This study identified how concurrent verbal reporting was appropriate for use during long-distance running and highlighted how data might be used to inform applied psychology support for endurance runners. For example, data suggested all participants found the start of their run difficult, this might highlight a need for sport psychologists to help runners adopt strategies (e.g. self-talk) that help them overcome the difficulty associated with the early miles of a run. In both studies [34, 35] there was a high level of ecological validity, and athletes were able to verbalise their cognitions appropriately during performance. Despite an abundance of empirical literature originating from the talent in sport domain, a key omission is evidence surrounding “what” information talent scouts gather when deployed on scouting assignments or, indeed, evidence of their actual “thoughts”.

The aim of this study, therefore, is to present a methodology for depicting concurrent cognitions of talent scouts during part of the talent identification process (i.e. observing a live game) by means of a verbal reporting protocol. Specifically, it is our intention to consider the feasibility of establishing a standardized reporting protocol for talent identification purposes. Study 1 develops a rigorous coding scheme and player-positional attributes for examining verbal report data. Study 2 utilises the methodology developed in Study 1 to compare the concurrent verbal cognitions of two talent scouts undertaking a “live” talent identification assignment of two junior-elite soccer sides playing against each other.

Study 1

Methods

Study design and participants

An exploratory case study design was utilised for this study, that allowed the research team adequate flexibility given the multidisciplinary nature of the inquiry [36]. One main advantage of true case study design is its allowance for collaboration between the researcher and participants [37]. The development of our codebook and coding definitions followed a series of systematic and sequential stages. First, a list of specific player attributes identified from a previous talent identification project published and archived elsewhere (i.e. [38]) was incorporated into a video-based, simulated training and analysis tool. The player attribute categories (i.e. psychological, technical, physical, and hidden) were subject to content validation by a panel of full-time academy coaches and recruitment staff (n = 3) who were enrolled on an institutional postgraduate degree programme [39]. Panel members ranged in age from 22 to 28 years (M = 25 years; SD = 3).

A 48-match sample of in-game footage of Nike Academy (16-20-year-olds) matches for the 2017 season was used during the study and identified examples of players performing in a number of number of outfield positions (i.e. central defender, full-back, central midfield, left/right midfield and central wide/attacking player). The Nike Academy was an English football academy funded and administrated by Nike, Inc. until 2017. The academy had a revolving squad of unsigned under-20 players and was run with the intention of helping players find a professional football club. The academy was based at St Georges Park National Football Centre (UK) and the squad was made up of players scouted worldwide and drafted to the squad through the Nike Most Wanted football trials. Full ethical approval was provided by Liverpool John Moores University Ethics Committee (15/EHC/044), and verbal and written informed consent was obtained from the participants and the Nike Academy to use match recordings.

Procedure for standardizing player-performance attributes

In this study, we used a reliable and valid procedure to generate video clips of the required attributes for all six outfield playing positions (central defender, fullback, central midfielder, wide midfielder, centre-forward and wide attacker). The standardization process followed the systematic review of 4320 minutes of match footage in order to find video clips that were representative of various outfield positions. All the agreed player film sequences were incorporated into SportsCode Gamebreaker 10.3.1. for editing and reviewing purposes by members of the research team. Training in the use of SportsCode Gamebreaker 10.3.1. was provided by one of the authors (AM) (~3 hours training) who has extensive experience of performance analysis education. In total (n = 15) film sequences were produced for each of the outfield positions (i.e. central defender, fullbacks, central midfielder, wide midfielder, centre-forward and wide attacker). Each positional sequence contained (n = 10) clips that lasted for approximately 90 seconds each (15.00 minutes total).

Validation of coding scheme

To test for attribute acceptance for each position, we asked the participants to watch the video clips and to concurrently verbalise their cognitions from when the video clip started until it ended. Before the beginning of each clip, a black screen presented the name of the playing position and a numbered countdown (3-2-1) was provided, to aid participant visualisation [40]. In addition, a still image with a circle around the player under observation was shown. To achieve acceptable content validity, the observations were recorded and consensus as to whether the attributes were efficiently shown in the player position-specific videos was determined. This approach demonstrated the presence of these attributes and provided the likely language a scout would adopt when thinking about the attribute. In order to confirm the existence of the definitions within each category two members of the research team independently reviewed the recordings and used the following equation to determine inter-observer agreement (IOA): [(Agreements) / (Agreements + Disagreements)] x 100. For example, if there was eight agreements and two disagreements then the equation would be [(8) / (8 + 2)] x 100 = (8/10) x 100 = 80%]. In order to check for observer consistency, the intra-observer reliability (IOR), was established by performing the same test, two weeks after the initial data collection sufficient time for complete memory lapse.

Results

The results of this study found that the IOA for central defender was 0.87 (87%); full back 0.80 (80%); central midfielder 0.84 (84%); left/right midfielder 0.80 (80%) and central/wide attacking player 0.86 (86%). The results of the IOR for central defender were 0.83 (83%); full back 0.81 (81%); central midfielder 0.83 (83%); left/right midfielder 0.82 (82%) and central/wide attacking player 0.84 (84%).

Study 2

Methods

Participants

Following full ethical approval, provided by Liverpool John Moores University Ethics Committee (15/EHC/044), two full-time talent scouts (i.e. Adam and Ben [pseudonyms]) were purposively sampled from a category one English Premier League academy (see [17], for an overview of academy category status). Adam (44 years) had worked as a talent scout for (17 years) and Ben (26 years) had worked as a talent scout for (3 years). Purposive sampling methods are commonly regarded as suitable for studies where the research team are interested in capturing the best knowledge concerning the research topic and studies which employ content analysis procedures [39]. Prior to commencing the study both Adam and Ben provided written informed consent and were notified that they could withdraw from the study at any time. Gatekeeper consent to undertake video recording was obtained from the club’s academy director as well as the gatekeeper for the opposing team, subsequent informed consent was also obtained from each individual player.

If we are to fully understand the role of the talent scout and their decision-making processes it is important the complexities of the identification process are captured in situ before attempting to recreate similar conditions in more controlled, simulated environments [41]. The study was, therefore, conducted at the club’s academy site as the research team were granted permission by the club’s academy director, to observe and record a competitive game between the clubs under 15 team and another junior-elite under 15 team. The game was played mid-week, kick off 1900 hours, on a regulation size (100.5m x 64.0m) artificial 4G pitch, under floodlights with clear weather conditions.

Procedure

Adam and Ben were trained in concurrent verbal reporting using an adapted version of the instructions outlined by Ericsson and Kirk [42]. This included assigning warm-up exercises such as mental calculations to shape their verbal behaviour. For example, “So that you understand what I mean by think-aloud, let me give you an example. Assume I asked you ‘How much is 127 plus 35?’. Now think-aloud so I can hear how you solve this problem. The participants practised providing verbal reports with feedback provided by members of the research team until level I or II verbal reports was established [43]. Training in concurrent verbal reporting techniques was provided by a member of the research team who has published previously using this procedure in both sport [44] and simulated medical domains [45]. All concurrent verbal report training was conducted on the day of the game to ensure complete understanding of the task requirements.

Prior to the game commencing, a Lavalier microphone and radio transmitter (Sennheiser ew 122-p G3), was connected to a Dictaphone (Olympus WS-853) which was fitted to both participants. Adam and Ben also wore GoPro camera’s (GoPro Hero 5) which were attached to their chest in order to determine whether the team they were scouting were in possession of the football or not. Adam and Ben were instructed to verbalise their thought processes in real-time without self-censoring, or attempting to justify or explain their thoughts, as per the verbal reporting protocol [31]. Each participant took up a position at pitch level on opposite sides of the pitch on the half way line (Fig 1) and engaged in a full 90-minute football game, with the typical 15-minute half-time interval. During the game, Adam and Ben were allocated a research assistant who stood behind them listening for verbal reporting occurring. If either participant stayed quiet for longer than 30-seconds, following verbal reporting protocols, they were prompted by the research assistant to “think aloud”.

Image of the pitch from Adam’s GoPro camera.
Fig. 1. Image of the pitch from Adam’s GoPro camera.
aThis image has been edited to be black and white to avoid identification of the participating teams through their kit colours.

For the first half of the game, Adam and Ben were asked to focus on the game as a whole. This was intended to represent a scouting assignment where no particular individual had been chosen for observation, and so the scout was responsible for identifying those individuals who they believed to be talented. For the second half, the research team selected two individuals from one team (the team with whom the scouts were not associated) to focus their attention and provide verbal report data.

Following the game Adam and Ben engaged in a debrief and informal semi-structured interview with members of the research team to discuss their thoughts on the verbal reporting protocol, including any difficulties or concerns that they had. This was recorded using a Dictaphone and transcribed away from the academy environment.

Data analysis

Verbal reports

Verbal reports for both participants were transcribed verbatim, generating 15 single-spaced pages of text from 189 minutes and 20 seconds of total recorded audio. Ericsson and Simon [43] outlined analysis procedures for verbal reporting protocols, where they highlighted relevance, consistency, and patterns of verbalisation streams as important. However, due to the exploratory nature of this study, and the broad range of factors likely to be covered by scouts in a dynamic game environment, it was deemed appropriate to conduct line-by-line deductive content analysis (see [46]). Deductive content analysis is often exemplified by cases where researchers wish to code data based on an existing categorisation matrix [46]. Any categorization matrix can be regarded as valid if the categories adequately and accurately captures what was intended [47].

Following transcription, verbal report data were converted to a Notepad text file and imported into Microsoft Excel (2016). Each verbatim statement was then coded using the coding criteria outlined in the codebook generated in Study 1. Each verbal report was then simultaneously and independently coded by a second trained member of the research team using the attribute definitions contained in the codebook. Each concurrent statement was coded using a colour system which was aligned to the attribute presented in Table 1. IOA estimates were conducted using the same method noted above, and suggested that two coders had equivalently coded (70.3%) of the verbalisations. The remaining verbalisations (29.7%) were re-coded by the two raters following a line-by-line debrief and discussion. Following line-by-line deductive content analysis, frequency counts of the individual phrases were imported into the statistical package for the social sciences (SPSS V25) where descriptive statistical analysis procedures were conducted (i.e. means and standard deviations).

Tab. 1. A detailed overview of the codebook.
A detailed overview of the codebook.

Informal debrief

The informal debrief data were transcribed line-by-line and content analysis with inductive reasoning was conducted to develop themes and a process of continual examination and comparison was performed. Following hermeneutic procedures provided by Thomas and Pollio [48], information-rich verbalisations were identified as meaning units, which were subsequently grouped into sub-themes. Verbalisations were pieces of coded text that related to an attribute and ranged in the number of words they contained. This process was initially completed by two (MJR & SR) of the research team before being shared with the remaining two team members (AM & CL) to consider trustworthiness surrounding interpretation of data.

Results

Descriptive analysis–verbal reports

The sample text references included a total of 11,696 words. There were 331 psychological attribute verbalisations coded (M = 9.9 words, SD = 14.09); 316 were coded as technical attribute verbalisations (M = 22.57 words, SD = 30.36) and 56 were coded as physicality verbalisations (M = 8 words, SD = 5.54). The tone of verbalisations were mostly neutral (48%). Positive verbalisations were coded 27% of the time, with negative accounting for 17%, and unknown 8%. For a full breakdown of the findings please refer to Table 2.

Tab. 2. Descriptive analysis of verbalisations.
Descriptive analysis of verbalisations.

Psychological attribute verbalisations

The highest frequency (n = 158) of coded verbalisations related to decision-making thoughts (47.7%). For example, in the first half of the game Adam stated: “Look to play, look to be positive good decision didn’t force it” and “Number four has it he’s a threat, can he get on it in midfield, no wrong way–poor decision”. The second most prominent verbalisation was off-the-ball thinking (13%) followed by positioning (12.1%). For example, in the first-half when the team Adam was scouting were not in possession of the football he said, “Got to see the danger on the weak side, he needs to drop in and get in position–poor play he was ball watching.” Adam and Ben also made a number of comments (11.5%) which were coded as attitude verbalisations. For example, following a mistake on the ball Adam commented “Poor play a lack of quality maybe too quick, now he needs to work hard and recover–good recovery there from the right back”.

Technical attribute verbalisations

The participants mentioned a number of technical attributes during the game, but the most prominent thoughts related to passing accuracy (32.9%), first-touch (23.1%) and dribbling/running with the ball (12.0%). Typical positive examples from Ben included “Good pass from [blinded]. Good ball”, a negative example “Bad touch from [blinded], should have done better” and a neutral example included “Can he travel, can he travel. Can he go forward”. Examples from Adam included “Great ball, good delivery well done”, and “Hold, hold, hold. Keep hold of it. Keep hold of it” and “Keep the ball, attack him, good. Keep going forward, set up the cross.”

Physical attribute verbalisations

The talent scouts mentioned 56 thoughts that related specifically to physical attributes. The scouts commented positively on players agility (28.6%), speed (21.4%) and strength (21.4%). For example, Ben stated, “great turn and change of direction–don’t stop drive, drive” and “That lad on the ball is quick–left side” and “Good strength through the middle”.

Hidden attribute verbalisations

The only hidden attribute that participants mentioned was communication (100%). For example, Adam noted “good talking from the skipper [team captain] there” and “he’s spending a lot of time talking”.

Informal interview

During the debrief with Adam and Ben, both indicated that the task was ‘extremely difficult’, more so than they had imagined it would be during the training. Following further discussion, participants identified that ‘things moved really quickly’ and they were ‘barely able to do more than commentate’. Indeed, the fast-paced nature of the game and the low-level of detail provided in the verbalisations suggest that the cognitive load was high for this particular task. That is, there was a lot of visual information for Adam and Ben to observe, synthesise, and verbalise before the game had already progressed. “It made keeping up with the game really hard…I felt like I’d not finished [verbalising] but I needed to move on to the next bit.”

The informal debrief with both participants was conducted approximately five minutes following the conclusion of the game. The debrief was short (19 minutes in total) but indicated the need for the research team to consider different approaches to examining the cognitive processes and strategies adopted by those responsible for talent identification in junior-elite football. When we asked Adam and Ben to reflect on the players that they were tasked with scouting in the second half it was interesting to note that both disagreed with the player attributes and both disagreed regarding the recruitment philosophy of their own club. Interestingly, the recruitment philosophy was visible in the interview room–a vinyl graphic occupying approximately two-thirds of a wall–when Adam and Ben were asked how accurate their thoughts and observations were in relation to this, they responded by further disagreeing with their previous verbalisations and aligning their responses to factors highlighted in the vinyl graphic. Such dissonance between philosophies and on-the-ground practice have been reported in previous studies [12, 14].

Discussion

The aim of this case study was to explore the use of a verbal reporting methodology to better understand the thought processes of soccer scouts during a live junior-elite soccer game. Study 1 developed a rigorous standardized verbal report coding scheme to be used in the analysis of verbal reports. The standardized coding form was created with the aim of providing an objective view of talent identification attributes that could be used in a practical setting. The content validation of the coding system suggests it is a versatile analysis tool which could be used to inform future talent identification studies or the training of talent scouts.

In the second study, talent scouts’ thoughts were captured during a live game utilising a verbal reporting protocol [43] and verbalisations were analysed using deductive content analysis. To our knowledge this is the first study to attempt to capture the thought processes of talent scouts using concurrent verbal reports despite this methodology featuring prominently in existing cognitive control accounts of skilled athletic performance [49]. This study, therefore, acts as a preliminary first step in the applied body of work in this area. Findings suggest that while the live-game observation yields high ecological validity, the dynamic nature of football creates too many variables for cognitions to be accurately verbalised due to time-pressures associated with the speed of the game. Participants, whilst attempting to do so, found themselves commentating as opposed to fully verbalising the cognitions of what they were seeing and how they were making sense of it and so some caution is required when interpreting these findings. Data suggested that Adam and Ben did not alter what or how they undertook scouting, regardless of the task focus (i.e. full team versus specific players). Indeed, there was no difference in the tone or number of verbalisations between the two tasks. When focusing on a specific player(s) Adam and Ben’s thought processes appeared to remain game focussed when their intended focus (i.e. a specific player) was out of possession and/or not particularly involved within a phase of play.

Psychological attributes

The most frequent perceptual-cognitive thoughts were coded as decision-making (n = 158) off-the-ball thinking (n = 43), and positioning (n = 40). The most frequent psychological attribute thoughts was attitude (n = 38). Perceptual-cognitive skills such as decision-making, and off-the-ball thinking are repeatedly reported to be advantageous in team sports and soccer specifically [50, 51]. Decision-making ability in a team sports such as soccer is commonly defined as the appropriateness of a decision, preceding a suitable action and is relative to the game context and specific interactions which occur between players of the same team and the opposition [52]. For example: “If my direct defensive opponent is far away from me, then I will shoot; or, if he closes me down, then I will do a step-over and drive past him” [53]. This ability to carry out two concurrent skills (i.e. dribbling the ball while scanning the pitch for the opposition or teammates) is considered an important attribute for performance in team sports [53]. The talent scouts in our study were coded when they explicitly commented on the players’ on-the-ball decisions, however, like others [52] the quality of the decision was difficult to assess, and as we did not explicitly assess whether the player decisions were ‘appropriate’ or ‘inappropriate’ we recommend that further work is conducted in this area. The high number of off-the-ball verbalisations is an interesting one especially when the majority of these were captured during the first-half when the scouts were requested to observe the whole game and not focus on a specific player or position. When we analysed the GoPro footage and cross-referenced the off-the-ball verbalisations it was apparent they were verbally reporting while still tracking the ball and, therefore, processing large amounts of information. It would appear the scouts were using effective visual search strategies, scanning the whole pitch and filtering lots of contextual information very quickly. At this stage we acknowledge that this is pure conjecture and requires more detailed experimental analysis in simulated conditions. This is, however, an interesting supposition as eye fixations are known to be one of the pre-requisites for superior performance in sport and other areas [54]. At this stage we are not aware of any eye fixation work that has been conducted with talent scouts or recruitment staff and although this is pure speculation at the moment, it may be worthy of further investigation. The procedural knowledge involved in the interpretation of a specific situation and the ability to be/or to get in the right place at the right time (i.e. positioning) is known to be a prerequisite for excellence in team sport [55]. Positioning is, however, dependent on systems of play, for example in a 3-5-2 system, the full-back or wide player (dependent on whether the team is in possession of the ball or not) may need to act as an attacker or defender. Future talent studies, therefore, may need to consider team formations and player positions a priori.

Technical attributes

The most frequent technical thoughts were attributed to passing accuracy (n = 104), first-touch (n = 73), and dribbling/running with the ball (n = 38). These findings are consistent with previous talent studies in soccer such as Larkin & O’Conner [29], who also reported first-touch and striking the ball as important. A technique was defined as the ability to carry out a solitary action with minimal cognitive decision-making. Passing accuracy (i.e. appropriate speed and angle) is considered an important technical attribute, especially for teams with a ball possession style of play. Despite a positive association between possession of ball time and team success [56] some caution is required as ball possession is multifaceted by extenuating factors such as playing style, quality of the opposition and the score of the match [57, 58, 59].

Physiological attributes

The most commonly coded physiological statement was agility (n = 16), however, physiological verbalisations were considerably lower than psychological and technical. Indeed, of the 727 verbalisations coded, only 56 (7.7%) were physical or physiological. There is a long history of talent-related literature suggesting a pre-disposition, or bias, toward physical and physiological factors associated with talent [6, 60, 61]. Indeed, much of the literature pertaining to relative age effect (RAE) has indicated that junior-players are more likely to be selected due to factors significantly affected by relative age [62, 63, 64]. The two other highest coded attributes were speed (n = 12) and strength (n = 12). Collectively, these three attributes have been considered in a number of previous studies [65, 66, 67] and their findings now considered best evidence in terms of the importance for talent identification, development, and monitoring purposes [68].

Hidden attributes

Communication (n = 24) was the only statement that was coded from the hidden attribute category. Similarly, this was the lowest coded attribute category, with only 24 (3.3%) verbalisations.

Strengths and limitations

Strengths of this study include a novel, two-study methodological approach to capturing scouts’ concurrent cognitions during in an in-situ environment. The study also captures follow-up qualitative data in an attempt to understand any holistic or philosophical differences regarding talent identification practice. A more comprehensive study design should incorporate and include talent scouts from different academies working colligatively, however, professional soccer clubs and their academies are not renowned for working in partnership and instead tend to be recondite about recruitment practice(s) [15]. This study, therefore, offers a unique insight into talent scouts’ “thoughts” on working in a professional soccer environment.

Despite these strengths, the study contains several shortcomings that need to be considered by researchers in talent identification. Firstly, although independent IOA estimates were acceptable, some of the coding constructs (e.g. decision-making, technique-under-pressure, and off-the-ball thinking) required interpretation from the research team. For example, it was difficult to distinguish between whether a decision-making thought reflected an on-the-ball (i.e. a skill or technique) or off-the-ball action. It is our contention that further validation of these constructs is required. Secondly, a small purposive sample of English talent scouts was used and although this sample is in-line with other verbal reporting studies [69] we acknowledge this as a less than representative sample. However, professional soccer clubs in England are notoriously secretive about their recruitment procedures and practices, and as other researchers can testify gaining access and acceptance in these environments can be extremely difficult [70]. Thirdly, as the qualitative data alludes to “thinking out loud” for the duration of a full 90-minute game was mentally draining for the participants and difficult. This may have impacted on how Adam and Ben undertook the two scouting tasks (i.e. whole team identification versus observing specific players). Indeed, both may have, potentially, been mentally fatigued following the first half and unable to differentiate between the tasks adequately.

Despite the current methodological shortfalls, modified versions of the task presented may offer future avenues for research in this area. Specifically, future research may be better to adopt a more controlled, lab-based, environment to examine the cognitive thought processes of scouts, and recruitment staff in more using larger sample sizes. Following Eccles and Arsal [71] we would also encourage a more detailed qualitative component to future studies that captures the nuances of how club recruitment philosophy influences the decisions made by staff responsible for this area of work for the football club. Finally, examining eye fixation would be an interesting development in this area so it is possible to determine where a scout is looking during a game. Eventually, this research might generate more accurate and reliable information for practitioners and researchers interested in understanding the complexities of the talent identification process.


Zdroje

1. Larkin P, Reeves MJ. Junior-elite football: time to re-position talent identification? Soccer Soc. 2018;19: 1183–1192. doi: 10.1080/14660970.2018.1432389

2. Grant RM. Contemporary strategic analysis: Concepts, techniques, application. 4th ed. Oxford: Blackwell; 2002.

3. Parnell D, Groom R, Widdop P, Ward S. The sporting director: Exploring current practice and challenges within elite football. In: Chadwick S, Parnell D, Widdop P, Anagnostopoulos C, editors. Routledge Handbook of Football Business and Management. Abingdon, Oxon: Routledge; 2019.

4. Sarmento H, Anguera MT, Pereira A, Araújo D. Talent Identification and Development in Male Football: A Systematic Review. Sport Med. 2018;48: 907–931. doi: 10.1007/s40279-017-0851-7 29299878

5. Bailey RP, Collins D. The Standard Model of Talent Development and Its Discontents. Kinesiol Rev. 2013;2: 248–259.

6. Vaeyens R, Lenoir M, Williams AM, Philippaerts RM. Talent identification and development programmes in sport: Current models and future directions. Sport Med. 2008;38: 703–714.

7. Baker J, Wattie N. Innate talent in sport: Separating myth from reality. Curr Issues Sport Sci. 2018;3: 1–9. doi: 10.15203/CISS_2018.006.

8. Schorer J, Wattie N, Cobley S, Baker J. Concluding, but definitely not conclusive, remarks on talent identification and development. In: Baker J, Cobley S, Schorer J, Wattie N, editors. Routledge Handbook of Talent Identification and Development in Sport. London: Routledge; 2017. pp. 466–76.

9. Johnston K, Wattie N, Schorer J, Baker J. Talent Identification in Sport: A Systematic Review. Sport Med. 2018;48: 97–109. doi: 10.1007/s40279-017-0803-2 29082463

10. Meylan C, Cronin J, Oliver J, Hughes M. Talent Identification in Soccer: The Role of Maturity Status on Physical, Physiological and Technical Characteristics. Int J Sport Sci Coach. 2010;5: 571–592.

11. Baker J, Wattie N, Schorer J. A proposed conceptualization of talent in sport: The first step in a long and winding road. Psychol Sport Exerc. 2019;43: 27–33. doi: 10.1016/j.psychsport.2018.12.016

12. Reeves MJ, Littlewood MA, McRobert AP, Roberts SJ. The nature and function of talent identification in junior-elite football in English category one academies. Soccer Soc. 2018;19: 1122–1134. doi: 10.1080/14660970.2018.1432385

13. Radicchi E, Mozzachiodi M. Social Talent Scouting: A New Opportunity for the Identification of Football Players? Phys Cult Sport Stud Res. 2016;70: 28–43. doi: 10.1515/pcssr-2016-0012

14. Reeves MJ, Roberts SJ, McRobert AP, Littlewood MA. Factors affecting the identification of talented junior-elite footballers: a case study. Soccer Soc. 2018;19: 1106–1121. doi: 10.1080/14660970.2018.1432383

15. Levett N. Foreword: talent identification in English junior-elite football. Soccer Soc. 2018;19: 1079–1080. doi: 10.1080/14660970.2018.1432387

16. Bailey R, Collins D. The problem with the pyramid: Why most models of talent development are flawed. In: Bailey R, Talbot M, editors. Elite Sport and Sport-for-All: Bridging the Two Cultures? Abingdon, Oxon: Routledge; 2015. pp. 72–84.

17. League Premier. Elite player performance plan. London; 2011.

18. Chesterfield G, Potrac P, Jones R. ‘Studentship’ and ‘impression management’ in an advanced soccer coach education award. Sport Educ Soc. 2010;15: 299–314. doi: 10.1080/13573322.2010.493311

19. Webb T, Wagstaff CRD, Rayner M, Thelwell R. Leading elite association football referees: challenges in the cross-cultural organization of a geographically dispersed group. Manag Sport Leis. 2016; 21: 105–123. doi: 10.1080/23750472.2016.1209978

20. Nicholls SB, Worsfold PR. The observational analysis of elite coaches within youth soccer: The importance of performance analysis. Int J Sports Sci Coach. 2016;11: 825–831. doi: 10.1177/1747954116676109

21. Dohme L-C, Backhouse S, Piggott D, Morgan G. Categorising and defining popular psychological terms used within the youth athlete talent development literature: a systematic review. Int Rev Sport Exerc Psychol. 2017;10: 134–163. doi: 10.1080/1750984X.2016.1185451

22. Williams AM, Reilly T. Talent identification and development in soccer. J Sports Sci. 2000;18: 657–667. doi: 10.1080/02640410050120041 11043892

23. Lund S, Söderström T. To See or Not to See: Talent Identification in the Swedish Football Association. Sociol Sport J. 2017;34: 248–258. doi: 10.1123/ssj.2016-0144

24. Holt NL, Mitchell T. Talent development in English professional soccer. Int J Sport Psychol. 2006;37: 77–98.

25. Henriksen K, Stambulova N, Roessler KK. Holistic approach to athletic talent development environments: A successful sailing milieu. Psychol Sport Exerc. Elsevier Ltd; 2010;11: 212–222. doi: 10.1016/j.psychsport.2009.10.005

26. Mills A, Butt J, Maynard I, Harwood C. Identifying factors perceived to influence the development of elite youth football academy players. J Sports Sci. 2012;30: 1593–1604. doi: 10.1080/02640414.2012.710753 22888797

27. Miller PK, Cronin C, Baker G. Nurture, nature and some very dubious social skills: an interpretative phenomenological analysis of talent identification practices in elite English youth soccer. Qual Res Sport Exerc Heal. 2015;7: 642–662. doi: 10.1080/2159676X.2015.1012544

28. Christensen MK. “An eye for talent”: Talent identification and the “practical sense” of top-level soccer coaches. Sociol Sport. 2009;26: 365–382.

29. Larkin P, O’Connor D. Talent identification and recruitment in youth soccer: Recruiter’s perceptions of the key attributes for player recruitment. PLoS One. 2017;12. doi: 10.1371/journal.pone.0175716 28419175

30. Ericsson KA, Simon HA. Protocol analysis: Verbal reports as data. Cambridge, MA: The MIT Press; 1984.

31. Ericsson KA, Simon HA. Verbal reports as data. Psychol Rev. 1980;87: 215–251. doi: 10.1037/0033-295X.87.3.215

32. Eccles DW. Verbal reports of cognitive processes. In: Tenenbaum G, Eklund R, Kamata A, editors. Measurement in Sport and Exercise Psychology. Champaign, IL: Human Kinetics; 2012. pp. 103–117.

33. McRobert AP, Ward P, Eccles DW, Williams AM. The effect of manipulating context-specific information on perceptual-cognitive processes during a simulated anticipation task. Br J Psychol. 2011;102: 519–534. doi: 10.1111/j.2044-8295.2010.02013.x 21752003

34. Nicholls AR, Polman RCJ. Think Aloud: Acute Stress and Coping Strategies during Golf Performances. Anxiety, Stress Coping. 2008;21: 283–294. doi: 10.1080/10615800701609207 18612855

35. Samson A, Simpson D, Kamphoff C, Langlier A. Think aloud: An examination of distance runners’ thought processes. Int J Sport Exerc Psychol. 2017;15: 176–189. doi: 10.1080/1612197X.2015.1069877

36. Yin RK. Case Study Research: Design and Methods. 4th ed. London: Sage; 2009. doi: 10.1016/j.ymeth.2008.10.015

37. Crabtree BF, Miller WL. Research Practice Settings: A Case Study Approach. In: Crabtree BF, Miller WL, editors. Doing Qualitative Research. London: Sage; 1999. pp. 293–312.

38. Roberts SJ, McRobert AP, Lewis CJ, Reeves MJ. Establishing consensus of position-specific predictors for elite youth soccer in England. Sci Med Footb. 2019; doi: 10.1080/24733938.2019.1581369

39. Elo S, Kääriäinen M, Kanste O, Pölkki T, Utriainen K, Kyngäs H. Qualitative Content Analysis. SAGE Open. 2014;4. doi: 10.1177/2158244014522633

40. Afonso J, Garganta J, McRobert A, Williams M, Mesquita I. Visual search behaviours and verbal reports during film-based and in situ representative tasks in volleyball. Eur J Sport Sci. 2014;14: 177–184. doi: 10.1080/17461391.2012.730064 24533524

41. Ford P, Coughlan E, Williams M. The Expert-Performance Approach as a Framework for Understanding and Enhancing Coaching Performance, Expertise and Learning. Int J Sport Sci Coach. 2009;4: 451–463. doi: 10.1260/174795409789623919

42. Ericsson KA, Kirk EP. The search for fixed generalizable limits of “pure STM” capacity: Problems with theoretical proposals based on independent chunks. Behav Brain Sci. 2001;24: 120–121. doi: 10.1017/S0140525X01283927

43. Ericsson K. A. and Simon HA. Protocol analysis; Verbal reports as data, revised edition. Cambridge, MA: The MIT Press; 1993.

44. McRobert AP, Williams AM, Ward P, Eccles DW. Tracing the process of expertise in a simulated anticipation task. Ergonomics. 2009;52: 474–483. doi: 10.1080/00140130802707824 19401899

45. McRobert AP, Causer J, Vassiliadis J, Watterson L, Kwan J, Williams MA. Contextual information influences diagnosis accuracy and decision making in simulated emergency medicine emergencies. BMJ Qual Saf. 2013;22: 478–484. doi: 10.1136/bmjqs-2012-000972 23396852

46. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62: 107–115. doi: 10.1111/j.1365-2648.2007.04569.x 18352969

47. Schreier M. Qualitative Content Analysis in Practice. London: Sage Publications; 2012.

48. Thomas SP, Pollio HR. Listening to patients: A phenomenological approach to nursing research and practice. New Jersey, NY: Springer; 2002.

49. Arsal G, Eccles DW, Ericsson KA. Cognitive mediation of putting: Use of a think-aloud measure and implications for studies of golf-putting in the laboratory. Psychol Sport Exerc. 2016;27: 18–27. doi: 10.1016/j.psychsport.2016.07.008

50. Roca A, Ford PR, McRobert AP, Mark Williams A. Identifying the processes underpinning anticipation and decision-making in a dynamic time-constrained task. Cogn Process. 2011;12: 301–310. doi: 10.1007/s10339-011-0392-1 21305386

51. Vaeyens R, Lenoir M, Williams AM, Philippaerts RM. Mechanisms Underpinning Successful Decision Making in Skilled Youth Soccer Players: An Analysis of Visual Search Behaviors. J Mot Behav. 2007;39: 395–408. doi: 10.3200/JMBR.39.5.395-408 17827116

52. O’Connor D, Larkin P, Mark Williams A. Talent identification and selection in elite youth football: An Australian context. Eur J Sport Sci. 2016;16: 837–844. doi: 10.1080/17461391.2016.1151945 26923813

53. Furley P, Memmert D, Heller C. The dark side of visual awareness in sport: Inattentional blindness in a real-world basketball task. Atten Percept Psychophys. 2010;72: 1327–1337. doi: 10.3758/APP.72.5.1327 20601714

54. Lebeau J-C, Liu S, Sáenz-Moncaleano C, Sanduvete-Chaves S, Chacón-Moscoso S, Becker BJ, et al. Quiet Eye and Performance in Sport: A Meta-Analysis. J Sport Exerc Psychol. 2016;38: 441–457. doi: 10.1123/jsep.2015-0123 27633956

55. Kannekens R, Elferink-Gemser MT, Visscher C. Positioning and deciding: key factors for talent development in soccer. Scand J Med Sci Sports. 2011;21: 846–852. doi: 10.1111/j.1600-0838.2010.01104.x 22126715

56. Bradley PS, Lago-Peñas C, Rey E, Gomez Diaz A. The effect of high and low percentage ball possession on physical and technical profiles in English FA Premier League soccer matches. J Sports Sci. 2013;31: 1261–1270. doi: 10.1080/02640414.2013.786185 23697463

57. Fernandez-Navarro J, Fradua L, Zubillaga A, Ford PR, McRobert AP. Attacking and defensive styles of play in soccer: analysis of Spanish and English elite teams. J Sports Sci. 2016;34: 2195–2204. doi: 10.1080/02640414.2016.1169309 27052355

58. Lago C. The influence of match location, quality of opposition, and match status on possession strategies in professional association football. J Sports Sci. 2009;27: 1463–1469. doi: 10.1080/02640410903131681 19757296

59. Lago C, Martín R. Determinants of possession of the ball in soccer. J Sports Sci. 2007;25: 969–974. doi: 10.1080/02640410600944626 17497397

60. Gregson W, Drust B, Atkinson G, Salvo V. Match-to-Match Variability of High-Speed Activities in Premier League Soccer. Int J Sports Med. 2010;31: 237–242. doi: 10.1055/s-0030-1247546 20157871

61. Di Salvo V, Gregson W, Atkinson G, Tordoff P, Drust B. Analysis of High Intensity Activity in Premier League Soccer. Int J Sports Med. 2009;30: 205–212. doi: 10.1055/s-0028-1105950 19214939

62. Helsen WF, van Winckel J, Williams AM. The relative age effect in youth soccer across Europe. J Sports Sci. 2005;23: 629–636. doi: 10.1080/02640410400021310 16195011

63. Vaeyens R, Philippaerts RM, Malina RM. The relative age effect in soccer: A match-related perspective. J Sports Sci. 2005;23: 747–756. doi: 10.1080/02640410400022052 16195025

64. Williams JH. Relative age effect in youth soccer: analysis of the FIFA U17 World Cup competition. Scand J Med Sci Sports. 2010;20: 502–508. doi: 10.1111/j.1600-0838.2009.00961.x 19538534

65. Váczi M, Tollár J, Meszler B, Juhász I, Karsai I. Short-Term High Intensity Plyometric Training Program Improves Strength, Power and Agility in Male Soccer Players. J Hum Kinet. 2013;36: 17–26. doi: 10.2478/hukin-2013-0002 23717351

66. Jovanovic M, Sporis G, Omrcen D, Fiorentini F. Effects of Speed, Agility, Quickness Training Method on Power Performance in Elite Soccer Players. J Strength Cond Res. 2011;25: 1285–1292. doi: 10.1519/JSC.0b013e3181d67c65 21522073

67. Thomas K, French D, Hayes PR. The Effect of Two Plyometric Training Techniques on Muscular Power and Agility in Youth Soccer Players. J Strength Cond Res. 2009;23: 332–335. doi: 10.1519/JSC.0b013e318183a01a 19002073

68. Beato M, Drust B. Fitness assessment in football. In: Gregson W, Littlewood M, editors. Science in Soccer: Translating Theory into Practice. London: Bloomsbury Sport; 2018. pp. 105–121.

69. Calmeiro L, Tenenbaum G. Concurrent Verbal Protocol Analysis in Sport: Illustration of Thought Processes during a Golf-Putting Task. J Clin Sport Psychol. 2011;5: 223–236. doi: 10.1123/jcsp.5.3.223

70. Roderick M. The world of professional football: A labour of love? Abingdon, Oxon: Routledge; 2006.

71. Eccles DW, Arsal G. The think aloud method: what is it and how do I use it? Qual Res Sport Exerc Heal. 2017;9: 514–531. doi: 10.1080/2159676X.2017.1331501


Článek vyšel v časopise

PLOS One


2019 Číslo 11
Nejčtenější tento týden
Nejčtenější v tomto čísle
Kurzy Podcasty Doporučená témata Časopisy
Přihlášení
Zapomenuté heslo

Zadejte e-mailovou adresu, se kterou jste vytvářel(a) účet, budou Vám na ni zaslány informace k nastavení nového hesla.

Přihlášení

Nemáte účet?  Registrujte se

#ADS_BOTTOM_SCRIPTS#