Validation of the Chinese version of academic goals orientation questionnaire in nursing student: a study based on SEM and IRT multidimensional models Authors: Yuqing Li, Lei-lei Guo, Jiaofeng Gui, Xiaoyun Zhang, Ying Wang, Haiyang Liu, Jinlong Li, Yunxiao Lei, Xiaoping Li, Lu Sun, Liu Yang, Ting Yuan, Congzhi Wang, Dongmei Zhang, Huanhuan Wei, Jing Li, Mingming Liu, Ying Hua, Lin Zhang Published: 2023 ABSTRACT AbstractObjectiveTo translate the Academic Goals Orientation Questionnaire (AGOQ) into Chinese and to determine the validity and reliability of the (AGOQ) in Chinese nursing students based on SEM and IRT multidimensional models.MethodsThe participants were 654 nursing students with an age range of 17–26 years (mean age 21.61 ± 1.73 years). The psychometric properties of AGOQ were investigated based on a dual analytical perspective of structural equation modeling (SEM) and item response theory (IRT).ResultsThe Cronbach’s α value of the questionnaire is 0.895. A four-factor model was obtained by exploratory factor analysis, which explained the variance of 71.892%. With confirmatory factor analysis, a new four-factors model was built and showed an acceptable goodness-of-fit, chi-square/degree of freedom (CMIN/DF) = 4.008, goodness of fit index (GFI) = 0.932, adjusted goodness of fit index (AGFI) = 0.905, comparative fit index (CFI) = 0.952, incremental fit index (IFI) = 0.952, Tucker Lewis index (TLI) = 0.941. In the analysis part of IRT, according to the comparison between Akek’s information criterion (AIC) and Bayesian information criterion (BIC), we choose the Graded Response Model (GRM) for analysis. The results show that the difficulty value is monotonically increasing, and the discrimination of all items is greater than 0.19, which shows that 16 items can be retained.ConclusionsThis study tested the psychometric characteristics of AGOQ of nursing students in China. The results confirmed that the Chinese version of AGOQ has good psychometric characteristics and can be used to measure the academic goal orientation of nursing students in China.Supplementary InformationThe online version contains supplementary material available at 10.1186/s12912-023-01630-0.Keywords: Academic goals orientation questionnaire, Nursing, Students, Reliability, Validity, Structural equation modeling, Item response theory Introduction The national standard for teaching quality of undergraduate majors in colleges and universities [1] required that nursing students should have the basic ability of independent learning and innovative development, and be able to adapt to the changing social health care needs. At the same time, it is necessary to mobilize teachers’ subjective initiative, improve students’ active learning, and actively carry out student-centered teaching aimed at improving students’ autonomous learning ability and innovation ability. In China, the role of learning goal orientation has also been brought into play in teaching in various fields. For example, when setting course objectives, the learning objectives of nursing specialty will be divided into three aspects: knowledge objectives, skills objectives and attitude objectives. Through the evaluation of the effect of achieving the goal, teachers can know the students’ mastery and curriculum preference in time and give professional guidance to the greatest extent. Academic goals were defined as the content and direction of one’s motivation for academic success or failure [2, 3], which were divided into four types of goals [4]: (i)learning or task goals, (ii)ego self-enhancement goals, (iii)ego self-frustration goals, and (iv)work avoidance goals. Research on different types of academic goals has traditionally considered learning and performance [5]. Goal orientation was based on achievement motivation goal theory. The goal perspective theory of achievement motivation [4] focused on identifying different types of goal orientations among students. The view that there were two goals had received special attention. These viewpoints were called task-oriented and self-oriented [6, 7]. However, some researchers also suggested that students may be avoidance-oriented in learning situations. Factor analysis showed that task orientation, self orientation and avoidance orientation are different goal orientation factors. In 1997, Norwegian scholars [4] studied a prediction among Norwegian students in grades 6 and 8, that was, self-orientation had different dimensions (self-frustration and self-enhancement), which may be separated from other goal orientations. There was a weak correlation between self-frustration and self-enhancement, and both dimensions were independent of task orientation. And they were related to academic achievement. In addition, Nicholls et.al [7] suggested that, as mentioned above, students may be evasive in learning situations. The measurement of job avoidance showed high reliability [7], and factor analysis also showed that it can be separated from task orientation and self-reinforcement orientation. The above results were verified by students in 2012 [8] and 2020 [9], and the final academic goal orientation was determined as four dimensions, namely, ego self-frustration goal, ego self-enhancement goal, work avoidance goal and learning or task goals. First, students with Type I goals (learning or task goals) focused on intrinsic stimuli and sought to absorb knowledge, acquired skills, and gained a true understanding of the problem [10]. In short, they wanted to learn and improve their skills, so they were also called task-focused goals. Second, students with Type II and III goals (ego self-enhancement goals, ego self-frustration goals) were social in nature and students tried to satisfy external needs through academic achievement. Ego self-enhancement referred to seeking favorable outcomes, and ego self-frustration referred to having a defensive attitude and seeking to avoid setbacks and unfavorable images [4]. Both types of academic orientation had a social component. In other words, students sought social, academic, or family approval either to be better than their peers or to conceal mediocre performance, rather than to satisfy their intellectual needs [11]. Finally, the Type IV goals (work avoidance goals) referred to students avoiding learning activity engagement by using customary avoidance behaviors, such as expending minimal effort and avoiding complex tasks [12]. Barkur et al. [13] examined the correlation between learning goal orientation and academic performance and concluded that students with lower grades tended to engage in work avoidance compared to students with higher grades. The result was similar to those obtained by Palos et al. [14] among nursing students. However, no Chinese studies on this topic were found during the literature search, possibly due to a lack of validated tools to measure students’ orientation toward academic goals. Academic goals orientation questionnaire (AGOQ) was first developed by a Norwegian scholar [4], and was translated into Spanish in 2012 [8] and applied to nursing students for the first time. In 2020, Manrique-Abril FG et al. [9] conducted a second verification on nursing students in Colombia (the official language is Spanish). The results showed that the questionnaire has sufficient validity and reliability in the Colombian context and can be applied to nursing students. In addition, the research on the academic goals of nursing students was helpful helpful in determining their academic orientation, thus becoming an auxiliary tool for teachers to select students and adjust the course content accordingly. Therefore, this study aims to translate the Spanish version of the academic goals orientation questionnaire (AGOQ) into Chinese and evaluate the psychometric properties of the AGOQ in Chinese nursing students based on SEM and IRT multidimensional models. Methods Design and sample Cross-sectional design and multi-stage sampling design were adopted in this study. From March to June 2023, a survey was conducted among nursing students in medical schools in Jinzhou, Liaoning Province, China. The investigators of this study are mainly nursing graduate students who conducted this study. They received unified training on how to use standardized language and guidance (Supplementary material 1 is the training guidance of investigators). All participants completed the test voluntarily. Inclusion criteria: (1) Full-time nursing students in school; (2) informed permission and voluntary involvement in this study; (3) Students who understand and voluntarily join this study. Exclusion criteria: (1) Students who are dropping out of school; (2) Students who are unwilling to participate in this study [15, 16]. According to Kendall’s working principle [17], the sample size is calculated using a rough estimation method of 10–20 times the number of variables. The survey questionnaire for this study includes 4 general demographic data items, 16 items of academic goals orientation questionnaire. A total of 20 variables needs to be analyzed. Considering the possibility of loss or invalidity during the sample recycling process, the sample size should be expanded by 20%, and the final sample size should not be less than 480 people. Finally, we collected 654 valid questionnaires. The instrument The AGOQ has 16 items and four factors that pose questions to guide student learning. Items were divided into four dimensions based on the type of academic goal orientation, namely (i) Ego self-frustration goal (items 4, 7, 11, 14), (ii) Ego self-enhancement goal (items 2, 6, 10, 3), (iii) Work avoidance goal (items 3, 8, 12, 15), and (iv) learning or task goals (items 1, 5, 9, 16). A five-point Likert scale was used to mark the answers that best matched the subjects’ current state (1 = strongly disagree, 5 = strongly agree). The reliability of the original scale with Cronbach’s alpha (α) > 0.8 in all dimensions was adequate [4]. The total content validity index was 0.72 and had sufficient internal consistency [8]. Translation procedure There were various phases in the translation guide [18–20]. First, two multilingual expert translators translated the AGOQ from Spanish to Chinese. The Chinese version was translated into English by two more multilingual expert translators. Second, a multilingual panel of four nursing professionals and two psychologists examined each item’s cultural and language equivalency. A preliminary test was given to 30 nursing students. The AGOQ was changed based on their comments. Supplementary material 2 shows the item of AGOQ. The stage of pre-survey We initially conducted a pre-survey and randomly selected 50 samples, and the following are the descriptive results of the pre-survey. The results of the pre-survey showed that the total score range of the scale is 16–64 (SD: 45.62 ± 11.10). The time to filled in the questionnaire is 3–6 min, with an average of 3.86 min. Supplementary material 3 shows descriptive results of the pre-survey on 50 nursing students. Data collection This study was completed between March and June 2023. The questionnaire included the Chinese version of AGOQ and socio-demographic information. This study adopted multi-stage sampling design. First, Jinzhou Medical University was randomly selected from 6 nursing colleges in Liaoning Province. Next, 50% of classes in each grade (ranging from one to three grade) were selected from the university [21], including the high school undergraduate and vocational college undergraduate students. As a result, 24 classes were selected by the university. In a final step, 25–30 students in each class were selected by cluster sampling. Our investigation was conducted twice, the first was a pre-survey and the second was a formal survey. We distributed questionnaires and collected them on the spot. Everyone can only fill in one questionnaire, and each questionnaire took 3.86 min. Finally, among 696 people, we collected 654 valid questionnaires. Thanks again! Statistical analysis SPSS 25.0, AMOS 23.0, and R 4.3.0 were employed to analyze the statistics. Cronbach’s alpha (α) [22–24] was used to study the internal consistency of the questionnaire and its dimensions. Exploratory factor analysis (the main component of Varimax rotation) [25, 26] was used to study the structural validity, and its viability was confirmed by Kaiser-Meyer-Olkin test (KMO) and Bartlett test [27, 28]. With EFA, the criteria for the load value of each item is not less than 0.40 on the common factor [29], and the additive contributing rate of the extracted common factors is higher than 40% [30]. To measure model fit in CFA, eight indices were used: chi-square/degree of freedom (χ2/df), goodness of fit index (GFI), adjusted goodness of fit index (AGFI), incremental fit index (IFI), Tucker-Lewis index (TLI) [31], and comparative fit index (CFI). GFI, AGFI, IFI, TLI, and CFI should all be greater than 0.90 [32, 33], and χ2/df should be less than 5 [34]. In order to evaluate the AGOQ, IRT models were used. Graded Response Model (GRM) and Generalized Partial Credit Model (GPCM) [35] were examined for improved model fit using Akek’s information criterion (AIC) and Bayesian information criterion (BIC), whose values are lower suggesting a better model fit [36, 37]. The AIC and BIC values for GPCM in the current study were 27,259 and 27,617, whereas those for GRM were 27,145 and 27,504, respectively. The GRM was used as a result since it had a better model fit. For each item, the discrimination parameters (α) and difficulty parameters (β) were estimated. Additionally, item characteristic curves, item information curves, and total (scale) information Curves were measured [38, 39]. The larger the area covered under the curves; the item can more accurately estimate nursing students’ academic goal orientations. Results Descriptive statistics Table 1 shows the descriptive results of the questionnaire. Of the participating 654 nursing students, the ages ranged from 17 to 26 years, with an average of (21.61 ± 1.73). Most of them were females (568,86.85%), sophomores (430, 65.75%), and living in urban (342, 52.29%). Table 1Frequency distribution of demographic characteristics(n = 654)VariablesGroupsN CityUrban34252.29Rural25338.69Suburbs599.02SexMale8613.15Female56886.85Age (years)17–2621.61 ± 1.73GradeFreshman29745.41Sophomore26740.83Junior9013.76 Frequency distribution of demographic characteristics(n = 654) Table 2 shows descriptive results of the AGOQ by sex and grade. In the questionnaire, the average score for learning or task goal is the highest (mean = 3.59, SD = 1.05), and the average score for ego self- frustration goal is the lowest (mean = 2.60, SD = 1.08). Table 2Descriptive results of the Academic Goals Orientation Questionnaire by sex and gradeDimensions and itemsSexGrade P MaleFemale P FreshmanSophomoreJuniormeansdmeansdmeansdmeansdmeansdF12.601.082.570.950.0312.831.052.500.962.680.920.010 Item42.591.142.671.070.3932.931.202.581.072.761.030.020 Item72.551.162.691.090.1582.881.112.591.102.821.070.020 Item112.631.192.511.080.0712.791.102.451.092.611.080.030 Item 142.641.252.421.030.0012.711.192.381.052.541.020.030F23.000.923.080.820.7163.070.843.100.842.980.800.291 Item 23.031.203.150.970.0133.160.993.171.033.030.960.292 Item 62.981.183.160.980.1183.161.033.191.002.981.020.079 Item 103.081.113.021.020.3883.071.043.041.032.991.010.845 Item 132.901.122.991.000.1652.870.983.021.032.930.990.411F32.970.962.820.780.0912.970.902.780.802.940.770.047 Item 33.081.252.871.100.1273.071.142.851.132.951.100.247 Item 82.941.142.851.060.9532.961.012.801.103.001.000.097 Item 122.941.222.781.010.0292.941.162.741.022.901.040.131 Item 152.921.222.791.020.1202.901.122.751.042.911.040.200F43.591.053.720.840.0033.490.923.750.843.680.900.062 Item 13.601.103.740.930.0123.570.983.750.923.701.010.330 Item 53.601.163.710.930.0013.401.023.750.933.701.010.021 Item 93.601.193.760.910.0003.491.063.770.913.761.000.069 Item 163.551.163.680.970.0113.491.043.730.993.580.980.087F1(Self- frustration goal, items 4, 7, 11, 14), F2(Ego self- enhancement goal, items 2, 6, 10, 13), F3(Work avoidance goal, items 3, 8, 12, 15), and F4(Learning or task goals, items 1, 5, 9, 16) Descriptive results of the Academic Goals Orientation Questionnaire by sex and grade F1(Self- frustration goal, items 4, 7, 11, 14), F2(Ego self- enhancement goal, items 2, 6, 10, 13), F3(Work avoidance goal, items 3, 8, 12, 15), and F4(Learning or task goals, items 1, 5, 9, 16) Reliability Table 3 shows Cronbach’s coefficient alpha for each item. According to the results of the reliability analysis, it can be seen that the standardized reliability coefficient of the Chinese version of AGOQ is 0.859, and the questionnaire is generally reliable. Cronbach’s Alpha value of each item after deleting the item is less than 0.859 of the whole, so no adjustment is needed. Table 3Cronbach’s coefficient alpha(n = 654, α = 0.05)ItemsDrop ifr droppedrItem40.8500.5030.586Item70.8490.5340.615Item110.8520.4700.558Item140.8510.4860.571Item20.8470.5680.638Item60.8500.5140.591Item100.8470.5620.634Item130.8500.5170.594Item30.8540.4350.530Item80.8540.4200.511Item120.8550.4120.502Item150.8540.4290.519Item10.8510.4980.573Item50.8510.4910.567Item90.8510.4850.560Item160.8530.4540.536Drop if: Cronbach alpha when the item is removed; r dropped: item-total correlation without the item; r: item-total (point-biserial) correlation Cronbach’s coefficient alpha(n = 654, α = 0.05) Drop if: Cronbach alpha when the item is removed; r dropped: item-total correlation without the item; r: item-total (point-biserial) correlation Validity Construct validity Exploratory factor analysis Table 4 shows the rotation sums of squared loadings. The Kaiser-Meyer-Olkin (KMO) test was 0.848, and Bartlett sphericity test was significant (χ2 = 6157.990; P < 0.001) [30]. The exploratory factor analysis (EFA) analysis, revealed four dimensions through the scree plot and eigenvalue (> 1.0) [40]. Four factors supported by the scree plot (Fig. 1) accounted for 71.892% of the variance, respectively explaining 20.256%, 19.788%, 17.099% and 14. 748%. Table 4Rotation Sums of Squared LoadingsModelof Variance (%)Ego self- frustration goalEgo self- enhancement goalWork avoidance goalLearning goal dimensionthe Total VarianceInitial model17.18214.48611.14810.68253.498Modified model20.25619.78817.09914.74871.892Kaiser-Meyer-Olkin Measure of Sampling Adequacy = 0.848, Bartlett’s Test of Sphericity, Approx. Chi-Square = 6157.990, P < 0.001 Rotation Sums of Squared Loadings Kaiser-Meyer-Olkin Measure of Sampling Adequacy = 0.848, Bartlett’s Test of Sphericity, Approx. Chi-Square = 6157.990, P < 0.001 Scree plot Table 5 shows factor load and communalities of each item in AGOQ of 16 items. According to the type of academic goal orientation, the items are divided into four dimensions, and the dimensions of the Chinese version of AGOQ are the same as those of the original version, namely (i) Ego self-frustration goal (items 4, 7, 11, 14); (ii) Ego self-enhancement goal (items 2, 6, 10, 3); (iii) Work avoidance goal (items 3, 8, 12, 15); and (iv) learning or task goals (items 1, 5, 9, 16). As a result, the load value of each project on one of the common factors is higher than 0.40, and there is no double load phenomenon [41]. Table 5Factor load and communalities of each item in AGOQ of 16 Items(n = 654)ItemsF1F2F3F4CommunalitiesItem 7 0.898 0.0160.2000.0430.848Item 4 0.887 -0.0060.2160.0870.841Item 11 0.859 0.0160.2760.0120.814Item 14 0.843 -0.0290.1180.1780.757Item 60.066 0.899 0.0880.1570.845Item 13-0.059 0.880 0.1260.1350.813Item 20.055 0.858 0.0760.1640.772Item 10-0.067 0.834 0.1660.1750.758Item 90.2300.023 0.835 0.0630.755Item 50.1850.163 0.790 0.0110.685Item 160.1860.099 0.783 0.1930.695Item 10.1760.178 0.702 0.2000.596Item 150.0110.1650.045 0.842 0.739Item 120.0580.1470.033 0.791 0.652Item 80.0680.1300.120 0.721 0.555Item 30.1580.1240.239 0.531 0.380F1(Self- frustration goal, items 4, 7, 11, 14), F2(Ego self- enhancement goal, items 2, 6, 10, 13), F3(Work avoidance goal, items 3, 8, 12, 15), and F4(Learning or task goals, items 1, 5, 9, 16) Factor load and communalities of each item in AGOQ of 16 Items(n = 654) F1(Self- frustration goal, items 4, 7, 11, 14), F2(Ego self- enhancement goal, items 2, 6, 10, 13), F3(Work avoidance goal, items 3, 8, 12, 15), and F4(Learning or task goals, items 1, 5, 9, 16) Confirmatory factor analysis The results of confirmatory factor analysis (CFA) are shown in Table 6. With CFA, in an original four-factor model with the Chinese version of the AGOQ, the fit indices were not acceptable (Table 6 and Fig. 2). Then, modification indices were taken to improve the fit indices, and a new four-factors model was built and showed an acceptable goodness-of-fit [34, 42–45], chi-square/degree of freedom(CMIN/DF) = 4.008, goodness of fit index (GFI) = 0.932, adjusted goodness of fit index (AGFI) = 0.905, comparative fit index (CFI) = 0.952, incremental fit index(IFI) = 0.952, Tucker Lewis index (TLI) = 0.941. (Table 6 and Fig. 3). Table 6Evaluation of fitness of SEM modelModelCMIN/DFNFIRFIIFITLICFIRMRGFIAGFIPGFIPRATIOPNFIPCFIInitial model5.0100.9210.9030.9360.9210.9360.0610.9120.8780.6570.8170.7520.764Modified model4.0080.9370.9230.9520.9410.9520.0620.9320.9050.6650.8080.7580.770Standard value< 5.000> 0.900> 0.900> 0.900> 0.900> 0.900> 0.500> 0.500> 0.500> 0.500> 0.500> 0.500> 0.500 Evaluation of fitness of SEM model Standardized four-factor structural model of the Chinese version of the Academic goals orientation questionnaire (n = 654); F1(Self- frustration goal, items 4, 7, 11, 14), F2(Ego self- enhancement goal, items 2, 6, 10, 13), F3(Work avoidance goal, items 3, 8, 12, 15), and F4(Learning or task goals, items 1, 5, 9, 16) Standardized four-factors structural model of the modified Chinese version of the Academic goals orientation questionnaire (n = 654); F1(Self- frustration goal, items 4, 7, 11, 14), F2(Ego self- enhancement goal, items 2, 6, 10, 13), F3(Work avoidance goal, items 3, 8, 12, 15), and F4(Learning goal dimension, items 1, 5, 9, 16) Discriminant validity In our study, the scores of the top (50%) and low (50%) groups were analyzed using a two-tailed independent samples t-test. As can be seen in Table 7, the difference in all scores between the two groups reached the significant level (P < 0.001). Table 7Discriminant validity analysis in AGOQ (n = 654)ItemLow-score groupmean ± SDHigh-score groupmean ± SD t P F11.68 ± 0.523.47 ± 0.63-39.708< 0.001Item41.76 ± 0.613.55 ± 0.60-37.910< 0.001Item71.77 ± 0.623.58 ± 0.62-37.452< 0.001Item111.61 ± 0.493.44 ± 0.68-39.671< 0.001Item 141.59 ± 0.493.31 ± 0.74-34.875< 0.001F22.32 ± 0.693.82 ± 0.62-29.411< 0.001Item 22.37 ± 0.703.90 ± 0.61-29.662< 0.001Item 62.38 ± 0.703.90 ± 0.65-28.743< 0.001Item 102.28 ± 0.733.79 ± 0.66-27.649< 0.001Item 132.24 ± 0.703.72 ± 0.68-27.301< 0.001F32.02 ± 0.673.66 ± 0.67-31.620< 0.001Item 32.02 ± 0.683.77 ± 0.72-31.981< 0.001Item 82.06 ± 0.723.67 ± 0.69-29.063< 0.001Item 121.99 ± 0.643.61 ± 0.67-31.747< 0.001Item 152.00 ± 0.693.61 ± 0.67-30.151< 0.001F43.03 ± 0.834.38 ± 0.48-25.579< 0.001Item 13.07 ± 0.854.38 ± 0.49-24.223< 0.001Item 53.01 ± 0.834.39 ± 0.49-25.909< 0.001Item 93.08 ± 0.834.40 ± 0.49-24.763< 0.001Item 162.96 ± 0.864.37 ± 0.48-25.829< 0.001F1(Self- frustration goal, items 4, 7, 11, 14), F2(Ego self- enhancement goal, items 2, 6, 10, 13), F3(Work avoidance goal, items 3, 8, 12, 15), and F4(Learning or task goals, items 1, 5, 9, 16) Discriminant validity analysis in AGOQ (n = 654) F1(Self- frustration goal, items 4, 7, 11, 14), F2(Ego self- enhancement goal, items 2, 6, 10, 13), F3(Work avoidance goal, items 3, 8, 12, 15), and F4(Learning or task goals, items 1, 5, 9, 16) Item response theory models In order to evaluate the AGOQ, IRT models were used. Graded Response Model (GRM) and Generalized Partial Credit Model (GPCM) were examined for improved model fit using AIC and BIC, whose values are lower suggesting a better model fit. The AIC and BIC values for GPCM in the current study were 27,259 and 27,617, whereas those for GRM were 27,145 and 27,504, respectively. The GRM was used as a result since it had a better model fit. According to Table 8, the range of all item discrimination factors was between 0.237 and 3.689. The parameters for difficulty ranged from − 16.603 to 6.460. Table 8Estimates of discrimination and threshold parameters for the Scale under the graded response model with the Graded Response Model(n = 654, α = 0.05)ItemsThresholdDiscriminationβ1β2β3β4αiItem4-1.0730.0340.8682.2903.300Item7-0.9980.0080.8162.1103.689Item11-0.8910.1670.9512.2303.267Item14-0.8570.2851.0302.4303.157Item2-3.447-1.2240.8303.3000.913Item6-4.349-1.7161.0763.9100.691Item10-2.739-0.9930.9973.0800.991Item13-3.258-1.0431.2683.5600.867Item3-2.870-0.5391.3473.4400.780Item8-2.651-0.6671.5423.7600.823Item12-2.688-0.3871.5343.7500.881Item15-2.386-0.3771.4923.5600.948Item1-14.584-9.753-2.6926.4600.237Item5-14.214-8.639-2.1096.2400.253Item9-16.603-9.918-2.7906.2600.241Item16-14.155-6.674-1.4325.4500.294 Estimates of discrimination and threshold parameters for the Scale under the graded response model with the Graded Response Model(n = 654, α = 0.05) The item characteristic curves and item information curves for the Chinese AGOQ are shown in Figs. 4 and 5, respectively. The curves of the Item characteristic curves showed that the order of categories’ thresholds for all the items was as expected, which meant that all categories were adequate in terms of placing a respondent on the scale. The distributions of the item information curves were multimodal. The shapes of items 1, 5, 9 and 16 were the steepest and provided more information than the other items. Figure 6 is the total scale information curve. The peak value of the curve is between − 1 and 1, which means that nursing students with ability level between − 1 and 1 get the most information through AGOQ scale evaluation. This shows that AGOQ scale has the strongest ability to distinguish the academic goal orientation of nursing students with abilities. Item characteristic curves Item information curves Total (scale) information curve Discussion The literature in nursing research links personal characteristics (such as child care or cultural differences) and other factors (such as study intensity, clinical practice, or a lack of a consulting plan) with academic burnout [46], dropping out of school, or achieving and maintaining academic goals [47, 48]. However, little research has been conducted on education, particularly on the sorts of academic aim orientation of nursing students in China. As far as we know, this is the first study on academic goals orientation questionnaire (AGOQ) among nursing students in China based on structural equation modeling (SEM) and item response theory (IRT) model. The test results show that the Chinese version of AGOQ has good psychometric characteristics and is an effective and reliable tool. These results are consistent with the original version developed by Skaalvik [4] and the academic goals orientation questionnaire verification conducted by Navea Martin [8] in Spain. Previously, Elliot [49] developed and verified a similar questionnaire among psychology students. March [50] used this questionnaire consisting of the same dimensions with three items per dimension among US nursing students, but the authors did not report its psychometric properties in the sample studied. Some scholars [14, 51] used other language versions of the questionnaire, and also obtained sufficient internal consistency among nursing students (α = 0.82 and α = 0.85). Although the questionnaire showed good internal consistency, it did not examine the psychometric properties. Therefore, the present study decided to use the questionnaire developed and verified by Skaalvik [4], because the Spanish version of psychometrics has been verified by scholars before [8]. In the exploratory factor analysis (EFA) model, this study extracted four factors which are the same as the original scale. The four factors explained 71.892% of the total variance, 20.256%, 19.788%, 17.099% and 14.748%, respectively. The measured values of the model fit well (chi-square/degree of freedom (CMIN/DF) = 4.008, comparative fit index (CFI) = 0.952, incremental fit index (IFI) = 0.952, Tucker Lewis index (TLI) = 0.941). The results showed that the model has strong factor load and explanatory difference. The results of confirmatory factor analysis (CFA) confirmed that the Chinese version of AGOQ had a fitting index. There was significant difference in discriminant validity between the high group and the low group (P < 0.001). In addition, each item of AGOQ has higher load value and commonality coefficient. The results also indicated that there were strong factor loadings and explained variance in the structural equation modeling, consistent with the EFA results. Significant differences are rarely found in the analysis of the dimensions and items of the questionnaire. The score of learning and task goal dimension is the only dimension with significant gender difference. This is consistent with previous scholars’ research [51], that is, women scored significantly higher in learning or task goals. With regard to work avoidance, freshmen scored significantly higher in job avoidance dimension than other grades. Students pursuing a work avoidance objective have been defined as individuals who constantly avoid putting in effort to meet exceptional levels of achievement, doing only the bare minimum to get by, and avoiding difficult activities [12, 52]. When freshmen enter a new learning environment, they may avoid trying difficult jobs because of their low adaptability. Among college students in China, there is a very interesting phenomenon “Buddhist-Style college students” [53], who had hoped that they could relax in college and not worry too much. In addition, through IRT analysis, AGOQ has certain discriminating ability, and all discriminating parameters are higher than 0.2, indicating that AGOQ is easy to distinguish the academic goal orientation of nursing students in China. In terms of difficulty, the difficulty is increasing monotonically, which indicates that AGOQ has acceptable difficulty. In total scale information curve, the peak value of the curve is between − 1 and 1, which means that nursing students with ability level between − 1 and 1 get the most information through AGOQ evaluation. This shows that AGOQ has the strongest ability to distinguish the academic goal orientation of nursing students with abilities around − 1 to 1. Limitations Some restrictions should also be considered. Firstly, a cross-sectional study was carried out in our study, so further longitudinal study is needed to confirm these results. Secondly, The sample of this study comes from a nursing school in Liaoning Province, China. The results of this study have regional limitations, so they can’t be generalized among nursing students in China. Therefore, further efforts should be made to expand the sample coverage and take into account the adaptability of different groups and hope to continue to verify the feasibility of the subscale in other areas of China in future research. Despite these limitations, the current research can be considered as groundbreaking research. Specifically, this study is the first time that China has used SEM and IRT models to measure the psychometric characteristics of AGOQ. Conclusions This study tested the psychometric characteristics of AGOQ of nursing students in China. The results confirmed that China version of AGOQ has good psychometric characteristics and can be used to measure the academic goal orientation of nursing students in China. Electronic supplementary material Below is the link to the electronic supplementary material. Supplementary Material 1: The training guidance of investigators Supplementary Material 2: The Academic Goals Orientation Questionnaire Supplementary Material 3: Descriptive results of the pre-survey on 50 nursing student (N=50) Acknowledgements We express our great gratitude to all the respondents and all the authors of the scales that have been used in this study. Abbreviations Adjusted goodness of fit index Academic goals orientation questionnaire Akek’s information criterion Bayesian information criterion Confirmatory factor analysis Comparative fit index Chi-square/degree of freedom Exploratory factor analysis Goodness of fit index Generalized Partial Credit Model Graded Response Model Incremental fit index Item response theory Kaiser-Meyer-Olkin Structural equation modeling Tucker Lewis index Author contribution Conceived and designed the research: LZ. Wrote the paper: Y-q L. Analyzed the data: Y-q L and LZ. Revised the paper: Y-q L, L-l G, J-f G, X-y Z, XY, LZ, H-y L, J-l L, Y-x L, X-p L, LS, LY, TY, C-z W, D-m Z, H-h W, JL, M-m L, and YH. The authors read and approved the final manuscript. Funding This work was supported by the Internal Medicine Nursing Teaching Team (202ljxtd02). Data Availability The datasets generated and/or analyzed during the present study are not publicly available to preserve the anonymity of the participants but are available from the corresponding author at reasonable request. Declarations Ethics approval and consent to participate This study was approved by the Ethical Review Committee of Jinzhou Medical University under the approval number JZMULL2023028. The study was initiated after informed consent was obtained from all participants. Throughout the study, we strictly adhered to the principles outlined in the Declaration of Helsinki to ensure the anonymity and confidentiality of participants’ information and data. Consent for publication Not applicable. Competing interests The authors declare no competing interests. Footnotes Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. References Associated Data Supplementary Materials Supplementary Material 1: The training guidance of investigators Supplementary Material 2: The Academic Goals Orientation Questionnaire Supplementary Material 3: Descriptive results of the pre-survey on 50 nursing student (N=50) Data Availability Statement The datasets generated and/or analyzed during the present study are not publicly available to preserve the anonymity of the participants but are available from the corresponding author at reasonable request.