Revista CEFAC
https://www.revistacefac.org.br/article/doi/10.1590/1982-0216/20262850226
Revista CEFAC
Original Articles

TRILHAR: Content validity of a child vocabulary screening instrument

TRILHAR: validade de conteúdo de um instrumento de triagem do vocabulário infantil

Alexandre Lucas de Araújo Barbosa; Cíntia Alves Salgado Azoni

Downloads: 0
Views: 165

Abstract

Purpose: to obtain evidence of the content validity of the TRILHAR instrument.

Methods: a cross-sectional and quantitative study using the TRILHAR instrument aimed to screen the receptive and expressive vocabulary of children between three and seven years old. The sample was composed of 15 judges specializing in the area of children, who evaluated the instrument in terms of theoretical rationale, screening principles and materials, in addition to filling out a form to evaluate the figures. For data analysis, the content validity index (CVI), the content validity index per item (CVI-I) and the content validity coefficient (CVC), were calculated. For the figures, the cutoff point adopted was 75% positive evaluations.

Results: all the criteria presented adequate CVI and CVC. However, in the IVC-I, the subcriteria graphic aspects and clarity in the description of the application booklet, were below expectations. In the analysis of the figures, 17 out of 100 presented a need for reformulation.

Conclusion: the TRILHAR has adequate content validity for screening the vocabulary of children between three and seven years of age. Its items have an adequate semantic structure, appropriate figures and an application booklet suitable for use in clinical and educational contexts.

Keywords

Child Language; Vocabulary; Language Tests; Child Development; Triage

Resumo

Objetivo: obter as evidências de validade de conteúdo do instrumento TRILHAR.

Métodos: trata-se de um estudo transversal e quantitativo, utilizando o instrumento TRILHAR, destinado à triagem do vocabulário receptivo e expressivo de crianças entre três e sete anos. A amostra foi composta por 15 juízes especialistas na área infantil, que avaliaram o instrumento quanto ao Racional Teórico, Princípios da Triagem e Materiais, além de preencherem um formulário para avaliação das figuras. Para a análise dos dados, calcularam-se o Índice de Validade de Conteúdo (IVC), o Índice de Validade de Conteúdo por Item (IVC-I) e o Coeficiente de Validade de Conteúdo (CVC). Para as figuras, o ponto de corte adotado foi de 75% de avaliações positivas.

Resultados: todos os critérios apresentaram IVC e CVC adequados. Contudo, no IVC-I, os subcritérios aspectos gráficos e clareza na descrição do caderno de aplicação ficaram abaixo do esperado. Na análise das figuras, 17 das 100 apresentaram necessidade de reformulação.

Conclusão: o TRILHAR apresenta validade de conteúdo adequada para a triagem do vocabulário de crianças entre três e sete anos de idade. Seus itens apresentam estrutura semântica adequada, figuras apropriadas e caderno de aplicação adequado para o seu uso nos contextos clínicos e educacionais.

Palavras-chave

Linguagem Infantil; Vocabulário; Testes de Linguagem; Desenvolvimento Infantil; Triagem

References

1. Chow J, Davies AM, Fuentes LJ, Plunkett K. The vocabulary spurt predicts the emergence of backward semantic inhibition in 18-month-old toddlers. Dev Sci. 2018;22(2). http://doi.org/10.1111/desc.12754 PMID: 30248216.

2. Carbonieri J, Lúcio P. Vocabulary assessment in Brazilian children: A systematic review with three instruments. CoDAS. 2020;32(3):e20180245. https://doi.org/10.1590/2317-1782/20202018245 PMID: 32609222.

3. Luo Y, Song H, Li W, Zhang X. The effect of vocabulary depth and breadth on english listening comprehension can depend on how comprehension is measured. Front Psychol. 2021;25(12):657573. https://doi.org/10.3389/fpsyg.2021.657573 PMID: 34113291.

4. Tran A, Tremblay K, Binder K. The factor structure of vocabular: An investigation of breadth and depth of adults with low literacy skills. J Psycholinguist Res. 2020;49(2):335-50. https://doi.org/10.1007/s10936-020-09694-8 PMID: PMC7436337.

5. Nazzi T, Bertoncini J. Before and after the vocabulary spurt: Two modes of word acquisition. Dev Science. 2003;6(2):136-42. http://doi.org/10.1111/1467-7687.00263

6. Parladé MV, Iverson JM. The interplay between language, gesture, and affect during communicative transition: A dynamic systems approach. Dev Psychol. 2011;47(3):820-33. http://doi.org/10.1037/a0021811 PMID: 21219063.

7. Song S, Su M, Kang C, Liu H, Zhang Y, Mc-Bride-Chang C et al. Tracing children's vocabulary development from preschool through the school-age years: An 8-year longitudinal study. Dev Sci. 2015;18(1):119-31. http://doi.org/10.1111/desc.12190 PMID: 24962559.

8. Lee J. Size matters: Early vocabulary as a predictor of language and literacy competence. Appl Psycholinguist. 2011;32(1):69-92. http://doi.org/10.1017/S0142716410000299

9. Borovsky A, Thal D, Leonard LB. Moving towards accurate and early prediction of language delay with network science and machine learning approaches. Sci Rep. 2021;11(8136). http://doi.org/10.1038/s41598-021-85982-0 PMID: 33854086.

10. So KKH, To CKS. Systematic review and meta-analysis of screening tools for language disorder. Front Pediatr. 2022;10:801220. http://doi.org/10.3389/fped.2022.801220 PMID: 35281230.

11. Belteki Z, Lumbreras R, Fico K, Haman E, Junge C. The Vocabulary of infants with an elevated likelihood and diagnosis of autism spectrum disorder: A systematic review and meta-analysis of infant language studies using the CDI and MSEL. Int J Enrion Res Public Health. 2022;19(3):1469. http://doi.org/10.3390/ijerph19031469 PMID: 35162492.

12. Calabrese P, Hedger N, Pritchard K, Stojanovik V, Pagnamenta E. Word learning in children with developmental language disorder: A meta-analysis testing the encoding hypothesis. J Mem Lang. 2015;145:104678. http://doi.org/10.1016/j.jml.2025.104678

13. Katsarou D, Efthymiou E, Kougioumtzis G, Sofologi M, Theodoratou M. Identifying language development in children with ADHD: Differential challenges, interventions, and collaborative strategies. Children (Basel). 2024;11(7):841. http://doi.org/10.3390/children11070841 PMID: 39062289.

14. van der Schuit, Segers E, Balkom H, Verhoeven L. How cognitive factors affect language development in children with intellectual disabilities. Res Dev Disabil. 2011;32(5):1884-94. https://doi.org/10.1016/j.ridd.2011.03.015 PMID: 21498046.

15. Lammert JM, Roberts AC, McRae K, Batterink LJ, Butler BE. Early identification of language disorders using natural language processing and machine learning: Challenges and emerging approaches. J Speech Lang Hear Res. 2025;68(2):705-18. https://doi.org/10.1044/2024_JSLHR-24-0051 PMID: 39787490.

16. Spicer-Cain H, Camilleri B, Hasson N, Botting N. Early identification of children at risk of communication disorders: Introducing a novel battery of dynamic assessments for infants. Am J Speech-Lang Pathol. 2023;32(2). http://doi.org/10.1044/2022_AJSLP-22-00040 PMID: 36787149.

17. Steele S, Gibbons L. Vocabulary assessment techniques: Perspectives of school-based speech-language pathologists. Commun Disord Q. 2022;44(2):79-88. https://doi.org/10.1177/10483950231211841

18. Rescorla L, Nyame J, Dias P. Vocabulary development in european portuguese: A replication study using the language development survey. J Speech Lang Har Res. 2016;59(6):1484-90. http://doi.org/10.1044/2016_JSLHR-L-15-0294 PMID: 27960004.

19. Schaefer B, Bowyer-Crane C, Herrmann F, Fricke S. Development of a tablet application for the screening of receptive vocabulary skills in multilingual children: A pilot study. Child Lang Teach Ther. 2015;32(2):179-91. http://doi.org/10.1177/0265659015591634

20. Marcotte A, Clemens N, Parker C, Whitcomb S. Examining the classification accuracy of a vocabulary screening measure with preschool children. Assess Eff Interv. 2016;41(4):230-42. http://doi.org/10.1177/153450841663223

21. Puglisi ML, Blasi HF, Snowling MJ. Screening for the identification of oral language difficulties in Brazilian preschoolers: A validation study. Lang Speech Hear Serv Sch. 2020;51(3):852-65. http://doi.org/10.1044/2020_LSHSS-19-00083 PMID: 32496867.

22. Pernambuco L, Espelt A, Junior HVM, Lima KC. Recommendations for elaboration, transcultural adaptation and validation process of tests in speech, hearing and language pathology. CoDAS. 2017;29(3):e20160217. http://doi.org/10.1590/2317-1782/20172016217 PMID: 28614460.

23. Barbosa ALA, Soares HB, Azoni CAS. Development of a vocabulary-screening tool for children 3 to 7-years of age. Audiol., Communic. Res. 2019;24:e2131. http://doi.org/10.1590/2317-6431-2019-2131

24. Polit D, Beck C. The content validity index: Are you sure of what's being reported. Res Nurs Health. 2006;29(5):489-97. http://doi.org/10.1002/nur.20147 PMID: 16977646.

25. Mokkink L, Herbelet S, Tuinman P, Terwee C. Content validity: Judging the relevance, comprehensiveness and comprehensibility of an outcome measurement instrument - a COSMIN perspective. J Clin Epidemiol. 2025;(185):111879. http://doi.org/10.1016/j.jclinepi.2025.111879 PMID: 40562250.

26. Swan K, Speyer R, Scharitzer M, Farneti D, Brown T, Woisard V et al. Measuring what matters in healthcare: A practical guide to psychometric principles and instrument development. Frontiers in Psychology. 2023;14:1225850. http://doi.org/10.3389/fpsyg.2023.1225850 PMID: 37790221.

27. Mokkink L, Prinsen C, Bouter L, Vet H, Terwee C. The COnsensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105-13. https://doi.org/10.1590/bjpt-rbf.2014.0143 PMID: 26786084.

28. Polit D, Beck C, Owen S. Is the CVI na acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459-67. https://doi.org/10.1002/nur.20199 PMID: 17654487.

29. Yussof M. ABC of content validation and content validity index calculation. Educational Resource. 2019;11(2):49-54. https://doi.org/10.21315/eimj2019.11.2.6

30. Alexandre N, Coluci M. Content validity in the development and adaptation processes of measurement instruments. Cienc Saude Colet. 2011;16(7):3061-8. https://doi.org/10.1590/S1413-81232011000800006 PMID: 21808894.

31. Hernández-Nieto R. Contributions to statistical analysis: The coefficient of proportional variance, content validity and Kappa. Mérica: Universidad de Los Andes. 2002. ISBN: 978-1588987150

32. Swan K, Speyer R, Scharitzer M, Farneti D, Brown T, Woisard V et al. Measuring what matters in healthcare: A practical guide to psychometric principles and instrument development. Frontiers in Psychology. 2023;14:1225850. http://doi.org/10.3389/fpsyg.2023.1225850 PMID: 37790221.

33. Bernardi ACS, Botura C, Alves GS, Ribas LP. Phonological Assessment Instrument: Evidence of content validity and response processes. CoDAS. 2024;36(2):e20220324. http://doi.org/10.1590/2317-1782/20232022324pt PMID: 37878836.

34. Miranda MC, Pompéia S, Bueno OF. A comparative study of norms for a 400 picture set between Brazilian and North American children. Rev Bras Psiquiatr. 2004;26(4):226-33. http://doi.org/10.1590/s1516-44462004000400005 PMID: 15729455.

35. Mokkink L, Herbelet S, Tuinman P, Terwee C. Content validity: Judging the relevance, comprehensiveness and comprehensibility of an outcome measurement instrument - A COSMIN perspective. J Clin Epidemiol. 2025;185:111879. https://doi.org/10.1016/j.jclinepi.2025.111879 PMID: 40562250.

36. Snodgrass JG, Vanderwart M. A standerdized set of 260 pictures: Norms for name agreement, image agreement, familiarity and visual complexity. J Exp Psychol Hum Learn Mem. 1980;6(2):174-215. http://doi.org/10.1037//0278-7393.6.2.174 PMID: 7373248.
 


Submitted date:
01/26/2026

Accepted date:
05/20/2026

6a7c7cb8a953950ef45b21e9 cefac Articles

Revista CEFAC

Share this page
Page Sections